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ABSTRACT 

This report seeks to answer a set of related 
questions in the context of the United Kingdom: where technology 
education comes from, what it contributes to the curriculum and what 
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assessed. Part 1 describes and analyzes the evolutionary steps In the 
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years. It traces the historical evolution of design and technology in 
the United Kingdom as a school subject, pointing out how it 
complements and differs from science and craft. Part 2 describes a 
national assessment that the author developed to find out what 
students learn from technology taught as design and summarizes the 
results. These findings are reported: girls appear to be better at 
identifying tasks, investigating, and appraising ideas, whereas boys 
seem to be better at generating and developing ideas; and Craft 
Design and Technology course students consistently outperformed the 
coatrcl group. Part 3 describes why technology education has been so 
successful. It points out some compelling reasons that have led head 
teachers, administrators, parents, politicians, and employers to 
value the C':>ntribution that it makes to children* s development: the 
closeness between the process of design and technology and the 
process of thought; the centrality of communication; cooperative 
learning; and the direct link between technology in schools and 
subsequent industrial 'employment. Contains 35 references. (VLB) 
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Preface 



In the United Kingdonr^, design and technology have been combined into a new school subject that is 
intended to prepare ail young people better for the modem world. Students gain in-depth experience 
before the age of sixteen in actually designing and building practical technological systems that are sound 
and meet real human needs. This new subject has a larger place in the elementary and secondary school 
cun-iculum in the United Kingdom than do the various forms of technology educatton that are being tried 
out here in the United States. The author of this paper, prepared under contract to OTA for its study, 
Testing and Assessment in Vocational Education (March 1994) " traces the historical evolution of design 
and technology In the U.K. as a school subject, pointing out how it complements and differs from sdence 
and craft. He also describes a national assessment that he developed to find out what students learn from 
technology education taught as design and summarizes the results. The assessment employed 
methods of performance assessment to describe student's capabilities in actually designing and carrying 
out solutions to technological problems. In the last chapter he articulates reasons why he believes that 
learning about to<;hnology as design may be especially valuable for students in these nKxlem times. 

OTA neither specifically endorses nor approves either the entire contractor report or any of its contents in 
anyway. 
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Introduction 



This report has beer, compiled at the request of ^S^„^S°^^^^^^^^ S?was 
TflrhnPioav Assessmerrt. It iollows a seminar held in Washington in March issj io wnicii i wds. 
i^Jt^es^SI S o?the issues and events that are developed more fully herein. 

The report is presented in three parts vi^hich seek to answer a set of related questions in the 
context of the United Kingdom: 

• Where did Technology Education come from? 

. What does it contribute to the curriculum- what are its unique qualities? 

• How are we to assess excellence in our students? 

Technoloay i -emerged only recently in the British curriculum - though "s arrtecedents are 
JSu?aid ancTent But it is only thirty years since the first^Sepswe^^^^ 'S^^TlL 
teehnotoav in anvthina like its present form. In that short time it has moved frorn being a sioe 
IteTffiedSKe less able, to being at the heart of the new National Cumculurn (NC) - a 
STpJKS^ fr^Jl Sen from 5 to 16vears of age. This is a massive ach.ever^nt gj/en 
t^eT^^VSiding the British curriculum.-f It is quite remari<able that this new activity should 
lS?ve Sen^^uSiun elbowing its way in. There must be some compelling reasons 
underpinning its success. 

In nart one of this reoort ! attempt to describe and analyse the evolutioriary steps in the 
eoSSerSfe of te^Sy m the curriculum and 1 shall focus on the last thirty yeare. In part hree I 
oCSSImoK^s^U X been so successful: picking out some of the compelling 
?eaSns fhl? ha^ i^^^^^^ teachers, administrators, parents. PJ^^^ns and e^^^^^ 
the SmribSion that it makes to children's development. In part two of the report, I a^eng o 
a?hSre a doubte p^ of which revolve around the central question for any ojrncuter 

IS »SiT>S^EK>wwhaleff^ ■^'^''^^^^r^!!i?coS?th« 
SSnought l2Sh to describe the Department of Educatton's major research exercise in the 
atsessrJSm of pupil pertomiance in technotogy and to indicate how this research has extended 
our understanding of the nature of capability in technotogy. 



1 Ravmond Williams in his book The Long Revolution" provides a detailed account of the 
eme^e ofthSsh and includes that It Is -domlnantly 19th century, with many 

18tl- century features and a nwdlaoval core". 



The Evolution of Technology and its Assessment 



1 have chosen to present this section of the report chronologically. The weakness of this nriode of 
presentation is that the separate strands of the story are teased out across the whole time frame 
and thereby lose some of their internal coherence. The strength however, is that it has enabled 
nv/ to link the major milestones in the devetopment of technotogy education into a moderately 
coherent story. 



1960s 

Technotogy squeezed into the curriculum at the interface of science and technical or practical 
studies. It has inevitably therefore been shaped on the basis of the prevailing pedagogy in 
those two disciplines. Furthermore, given the divensity of curriculum practice in the 1960s it was 
equally inevitable that in its early stages, technotogy would not emerge as a single coherent entity 
but rather as a series of initiatives, each with a leaning towards one or other of the principal 
parents. 

Crude chara<^erisatfons of the two roots would show them to be dominated by a highly didactic 
methodology. In both cases pupils were seen to be empty vessels to be filled up with the 
desirable commodities on offer; respectively a large body of knowledge in the physical sciences 
and a large body of skills in wood and metal wori<shop practice. Typtoal activities in science would 
involve the dictatton of lads'* about a phenomenon - or in better resourced schools the copying 
of notes from books - possibly f oltowed by an 'exporiment". This experiment would be set up in 
such a way as to t)rove" that the facts were correct, and indeed my own notebooks are full of 
experiments To prove that..,.- We a(i knew that any divergence from the facts we were 
(supposed to be proving was undesirable, to the extent that even when the readings from the 
experiment clearty failed to prove it, they would be interpreted so that a fit might be seen to be 
possible. Very much the sam^ methodotogy informed practice in wood and metal workshops, 
only here the currency of exchange was not kriowledge so much as skills. Teachers were highly 
skilled craftsmen who took us through a sequence of practical projects that progressively 
introduced us to - and helped us to become proficient in using - hand and machine tools. 

The oracttoe of pupil assessment in these settings was predictable. Where the emphasis of 
teaching is on the acquisition of knowledge - the focus of assessment was not surprisingly on the 
extent to which pupils have acquired it and could rememtter it. Most assessment time in science 
was therefore devoted to tests of knowledge recall, supplemented with limited practical testing 
of experimentatton skills. In practteal subjects the traditton was slightly different - for though the 
focus of teaching was largely on the acquisitton of skills, this was not seen as the exclusive or 
even the dominant area for testing. The academto traditton of school- based examinattons 
emphasised the predominance of written tests, and even practtoal study areas were not to be 
seen as excepttons. Written papers therefore abounded on the underpinning theory of eg. 
wood growth, timber jointing and steel manufacture. These recall assessments were then 
supplemented with practtoal tests that typtoally involved the making of a specified arttole to a set 
drawing in a set time (pencil box with sliding Iki in 4 t)Our3). 

It is important to note here that there was no perceived relattonship between these two roots of 
technotogy. What went on in science labs was science, and the space between them and the 
workshops was both real (*he woricshops were well away adjoining the playing f iekls) and 
symbolto of the intellectual guH that divWed them. The fact that they had a very common 
pedagogy was not sufftoient to bridge the gulf . 
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Official Concern at an Unsatisfactory System 

Two official reports on the education system in the late 1950s and early 1960s expressed 
considerable disquiet at the state of the education sen^ice. The reports were complementary; 

• "15 - 18" The Crowther Report (DES 1959), focusing on the education of bright 17 
and 18 yr old pupils; ie the potential university entrant. 

• "Half our Future" The Newsom Report (DES 1963), focus'.ng on the education of 
13-16 yr olds of average and belovL* average ability; Ie the imminent school leaver. 

Both of these reports were seminal in tenns of Technology Education for they drew attention to 
the extent to which schools were failing youngsters of all abilities through the predominantly dry 
and lifeless approaches to teaching and teaming. Why - asked Crowther • do so many bright 
youngsters..." lose their Inteltectual curiosity before they have exhausted their capacity to learn"? 
In the famous chapter 35, the report recommends an alternative road to learning based on 
teasing out understanding from direct experience. Why • asked Newsom - does the education of 
15 yr oWs who are about to leave school bear no relation to the lives they are about to lead as 
independent citizens? 

Both reports made great play of the practical. Unusually however (for that time) sophisticated 
arguments were advanced underiying the virtues of practical wori^. Crowther, concerned with the 
essentially academic youngster in the 6th fonn argues... 

The boy with whom wo are ooncemed is one who has prido in his skill of hand and a dosiro to use 
that skill to discovor how things work, to make them work and to make them work better. The 
tradition to whk:h he aspires to belong is the modem one of the mechanical man whose fingers are 
the questioning instruments of thought and exptoratlon. 
(DES 1959) 

Here we have the practical clearly espoused as a route to intellectual growth. And shortly 
aftenward, Newsom chips in with a parallel visfon on behalf of the tower ability youngsters who are 
atx)ut to leave school... 

Pupils should be helped and stimulated to enlarge their understanding and practise their skills, 

often using direct experience as a starting point Objects made in the workshops should work. 

Time spent in the workshops was justified only if it should lead to thought and cwpression: they are 
nt^ to be regarded as a substitute for thought for the less intelligent 
(DES 1963) 

These two reports led • alnrx>st directJy - to the establishment of two cunrfeulum research and 
devetopment projects sponsored in both cases by the new Schools* Council, set up in the mkl 
1960s specifically to encourage cuniculum devetopment'^ . The two projects were respectively; 

Project Techfiology - whtoh drew heavily on the phystoal sciences and sought to "help 
all chikJren get to grips with technotogy as a major influence in society and as a result to 
help them to lead effective and satisfying lives". Its methodotogy was broadly to..." 
encourage technotogical activities in schools and thereby devetop a range of abilities and 
provide natives whtoh are often overtooked by more traditional approaches". (Schools 
Council 1968) 

• Education through the use of materials (sub$equer\tly called the Design & Craft project^ 
" whtoh sought to rehabilitate craft work by generating a designer/maker ethto. Whilst 
based dominantly in the workshop environment, the project sought to devetop a problem 
solving rattonale for the practfcal; needing in additton to practical skills...**a skill to Wentity 



1 Interestingly, the second curriculum bullefr ' produced (in 1 967) by the Schools Council was entitled "A School 
Approach To Technology". It is a good indica\.:ir of how high it was on the agenda. 
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and understand problems, to sift information and present reasoned argument". (Schools 
Council 1969) 



Both projects contributed to a major development in assessment. Both were based - with 
different emphases - upon design & technologicai problem solving, and it vas not surprising 
therefore that the problem solving process became the heart of assessment practice. To give a 
specific example, the Design & Craft project developed a 7 point design & make process which 
they translated into a 5 point assessment regime. 
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For the first time, judgments were being made alx>ut pupil capability in the whole design and 
development process as well as in terms of the quality of the made outcome. This inevitably 
caused a major upheaval of practice, and amongst other things placed considerable emphasis on 
the pupils ability to develop a portfolio of drawings/sketches/models/prototypes that articulated 
the development phases of the idea. Recording the thought process became very important. 

After the first ten years or so of the evolutton of Project Technology, the focus had shifted from 
an unsatisfactory dispute about whether knowledge (from the science tradition) or skills (from the 
craft traditton) should be the dominant influence In fashioning technotogical cunicula. The debate 
had moved to new and more Interesting ground; essentially over the extent to which technology 
was to be defined as a body of knowledge and skill (from either of the two roots) or altemath/ely 
as an activity, the ptvcess of which is paramount. 



1970s 



Within the secondary schools (11-16 or 11-18), the influence of the 16+ examination cannot be 
overstated, and the two devetopnwnts that are described below largely concern the 
development of two year (14 - 16) examination courses. The period leading up to these courses 
(11-14) was seen as provWing a preparation or foundation for the examinatton courses and very 
few formal requirements were placed on it. While systematic devetopment was focussed on the 
'examinatton courses, the foundatton courses were seen as an area in which teachers were able to 
make independent decisions. 

Whilst schools and teachers pfoneered individual - and often influential - pathways through these 
foundatton courses, there is no doubt that throughout the 1970s, the two nattonal research & 
devetopment projects - leading to examination courses for 16 yr olds - carried the banner of 
curriculum deve!opment in technology. And they consolidated very different fomis of 
technotogical activity In the cuniculum. 
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Project Technology 



Project Technology sough to develop three kinds of technological activity in schools: 

• tho whole technoogical project -trom the recognition of a problem through to its 
resolution in a designed and made product. 

• struaured courses In particular bodies of technological knowledge, for example in 
electronics, pneumatics, stmctures. materials. 

• subject enrichment In whfch for example a geography project might be enhanced 
through the devetopment of an inclinometer or river f tow meter. 

The second of these approaches was parttoularly successful with teachers. The structured 
courses were increasingly devetoped into ''modules'^ of study with serious theoretical input as 
well as practk^al exptoration and they were marketed as •'modular courses in technology". The 
modules were provkJed with detailed syllabuses, week by week programmes of study, prepared 
lists of equipment and resources, and prepared teacher hand-outs for pupils. For a teacher who 
was gingerfy finding his (it was almost exclusively a male preserve) way into technok)gy. it was a 
very supportive package, tt also has to be sakl that these modular courses - drawing heavily as 
they dkl on applied science - were dominantly seen to be for the more able. Gukiance to teachers 
on the pupils most suited to these t6Chnok)gy modules was quite explicit. 

...it is advisabio that the following questions be answered in the affirmative; 

1 Is the pupil in the top half of the ability range? 

2 Is the pupil interested in any aspects of engineering? 

3 Is the pupil practk:aliy inclined? 

4 is the pupil interested in science? 

5 Is the pupil competent in mathematics? 

6 Is the pupil interested in drawing? 

? !s the pupil interested in experimenting and innovating? 
(Schools Counctt 1973 quoted in Cross & McCormick 1989) 

By the mM-iate 1970s examination courses^ in Modular Technotogy ran typically along the 
following lines: 

• in year 1 of the course (15 yr olds) pupils study three modules from a list of eight, 
perhaps the most popular combination being electrontos. materials & mechanisms. 

• in year 2 of the course (16 yrs) pupils pursue a technok>gk:al project from start to 
finish, making use of the specialist knowledge and skills they acquired in year 1 . - 

Some wonderfully innovative work derived from such programnries. with one pupil designing an 
automata dispensirtg system to feed his goUf ish duririg a two week absence on hoiklay and 
another designing a pumping system that (using wave power) automatk^ally baled out his dinghy 
nfX)ored in the harbour. 

Such examinatton courses - whk:h woukl largely be of the academic GCE variety - woukJ then 
typically have the following assessment schedule: 

• two written examination papers - carrying 30% of mari^s for each 

- one generic about the impact of technotogy in soiiety 



^ It is necessary to understand that in the 1970s there existed two separate examination systems at I64. One 
system, the General Certificate of Education (GCE) was an academic examlnatbn designed for the top 40% of the 
population, tt was seen as a precursor to Advanced level examinations at 1 84' and thence for University entrance. 
The other system was the CertKicate of Secondary Educatbn (CSE) which was designed as a means to certKicate 
the remainder of the population. The two systems reflected the division of schools - Grammar schools for those who 
passed the 1 1-f tests and Second?iry schools for those who did not. In both examination systems the certificates 
applied to each subject studied, so m academic 16 yr old would expect to get nine good GCEs. and the average chikl 
in a Secondary school might achieve four CSEs. 
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- one specific dealing with the subject matter of the modules 
• a nrtajor project 

* carrying 40% of marks 

• this wou W Involve a full portfolio of design/development material as well as 
the final product and its evaluation in use. 

The Design & Craft Project 

The Design & Craft projeirt developed along somewhat different lines - most obviously with less 
errphasis on applied science and rather more on practical workshop activity. The project saw rtsetf 
redefining the context for designing and making in a way that took it beyond the school and out 
into the community. Groups of pupils were to be found redesigning footpaths and bridges in 
churchyards, or gutting t ie insWe of the youth-club and refitting it to meet more carefully thought 
out needs. 

The books and other resource materials emphasised the empowering nature of design in 
enabling us to intervene in and improve our environment. "You are a designer is a source book 
typfcal of the project; very visual and diagrammatic and seeking to portray the pivcess of 
designing In ways that appeal to pupils who wouW formeriy have been restricted to the basic crafts 
of wood and metal wori<. 

The assessment of the thought processes involved in designing was an issue that the project 
tackled head on and wr:h great success and partfculariy in the context of the CSE examination that 
grew out of the project^'. The whole examination revolved around the pupil's pursuit of a series of 
designing and making tasks, and In order to make them rigorous, the pupil's thought processes 
were tracked through t^le use of response booklets. They encouraged pupils to think through all 
the phases of the deskin task, keeping all the critfcal factors in mind and seeking out all the 
informatfon that they might need to tackle It. For example in the context of a playground redesign 
the booklet would have required pupils to think at different points of the project about a wkJe 
range of matters: 

• Who needs to be spoken to about the use of the playground? 

• Who uses the playground and what facilities are required ? 

• Are their any safety mles or laws that might be involved ? 

• What do chiWren like to have in playgrounds? 

• What do supien/isors need? 

• What const njction materials might be nrwst appropriate? 

• What budget applies to the project ? 

• How might the phases of design and constmction be planned ? 
etc etc etc 



The pursuit of answers to these and many other questions not only helped pupils to get to grips 
with the details of the task, it also provWed written evidence (in the booklet) of the thought 
processes involved. The booklet used a double page of questfons for each of the seven stages 
in the process (see p3). and along with the design fokJer. the booklet proved an invaluable 
assessment tool for teachers who needed to make judgments that went well beyond the quality 
of the end product - which might be a new seesaw or climbing frame. 



3 Whilst GCE ftxaminatlons wore typically traditional written examinations that were strictly controlled by University 
Examination Boards, the CSE examinations were very differerrt and controlled by Regional Examination Boards. 
They encouraged the development of innovative assessment schemes • even involving 100% project assessment 
with no written papers. Schools • or in this case the Design & Craft project • could devise assessment arrangements 
for their course of study and submit it for approval by the regional board. The project developed a new examination 
called simply 'Design Studios* which was approved by the NW regional examination group in 1972. 
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Comprehensive Schools Highlight the Examinations Problem 



Throughout the decade there was a progressive reform of the education service that had the 
effect of transfonfning it from a selective system (Grammar and Secondary Schools) to a non- 
selective system in which the vast majority of pupils were educated In Comprehensive schools'* 
taking all pupils from a oonrununity. Thia resulted in the two examination systems - GCE and CSE - 
becoming Increasingly anachronistic and the pressure began to mount for a single system of 
examining at l&f. 

The problem can be simply stated: 

• the GCE system was traditional and academic and respected by the University 
establishment. It was not well loved by teachers - particularly those from f ornier 
Secondary schools - who saw it as remote from teaching courses and as generally 
penalising pupils who did not have fluent literary skills. 

• the CSE system was more ctosely tuned to the teaching in schools involving much more 
use of continuous assessment and a range of approaches in additton to traditional written 
examinations. CSE examinations were generally thought by teachers to provide more 
valkJ measures of pupil capability, but they were not generally acceptable (or at least not 
as acceptable) for university entrance. 

Many pupils - partteularty those in the mkJdIe ground - were given impossible chofces between 
pursuing interesting, innovative courses that led to a qualif fcatton that had little currency in higher 
educatton, or alternatively stogging through iTWCh more tradittonal courses that resulted in a more 
Valuable* qualiffcatton. By the late 1970s the pressure was buikJing up to reforni the examinattons 
and provkJe a common system of examining at 16+. As we shall see. this pressure eventually 
resulted in a single examination system being introduced in 1986. 



Assessment of Performance Unit 



The 1970*s were years of conskJerstole devetopment for Technology in schools, but there were 
also the first stinings of another set of innovattons - inspired by an increasing awareness of the 
need for accountability In educatton. The Assessment of Perfomiance Unit (APU) was set up In 
the mW 1970*s to monitor the educatton system. The basis of its operatton was to devetop tests 
for pupils at a ra' ^e of ages (typteally 8,1 1 ,13 and 15) and to administer these tests to a sample of 
pupils. Light sampling systems were devetoped involving 2% of the populatton in tests that woukl 
typfcally be 30-50 minutes tong - with very small sub-samples engaged in tonger practical testing. 
The klea underpinning APU was that the first round of tests woukJ create benchmarks of 
perfomiance whfch coukJ then be checked on a 5 year rotatton of testing that wouW tell us 
whether the system was Improving or not and In what aroas. The first round of APU testing in 
1977-8 involved Language (English) and Mathemattes, followed shortly aftenvards by Science 
whtoh came on stream in 1980. The Design & Technology APU project dkJ not get into the frame 
until 1985, and the details of its approach will be examined In part two of this report. 

Initial teacher reactfon to APU was hostile because it was seen as a foot in the door for external 
accountability and appraisal. Progressively however it became seen as a real force for good - and 
for two reasons. 

First, the fears about using it as a check on teacher performance were allayed when it becanrie 
polfcy that all testi %| should be confklential; schools and pupils wouW be selected at random and 
not Wentif led. They would represent the system without being indivWually accountable, and data 
from the testing infonned the system as a whole. Second, it became ever more apparent that 
some very imaginative test devetopment was issuing from the APU. The devetopment of the 



^ There is some scepticism about how real this transformation was - as most Comprehensives were formed by the 
merger of a Grammar with a Secondary school in the same town and the internal selection systemu olten retained 
many features of ihe former arrangements. Nonetheless, 1 U testing largely disappeared. 



assessment frameworks themselves were interesting and broke new ground, and when these led 
on to some quite new and (in teachers eyes) very valid approach to monitoring perfomnance, the 
initial defensiveness of teac:iers changed into an open welcome. Despite the workload involved, 
when the computer selected a school for APU testing, the common reaction in that school was 
very positive. It was seen as providing (at someone else's expense) very good in-sen/ice training 
in assessment for the staff in the school. 

The Design & Technology APU project, when it hit the schools between 1986-9. was seen to fit 
the innovating style of APU and was very wamnly received. 



1 980s 

If the 1 970s was a period of development in Technology, the first half of the 1980s was one of 
consolidation. The driving force underpinning this consolidation was not restricted to 
technology, but involved a wider policy that might be seen as the first step towards the National 
Curriculum. It took the form of a wide ranging review of existing courses leading to a 
rationalisation of the examination syllabuses that were on offer at 16+. Why were there so many? 
Why did so many of them overiap with each other? Why was there so much duplication? The 
debate was as applicable in technology as it was in mathematics or any other subject. There were 
literally hundreds of different examination courses in design & technology, and in technology. 
They were all somewhat different from each other, and had grown (largely) from the opportunities 
that had been provided In the 1970s to devetop customised CSE examinations for particular 
client groups and in response to ind^ykluai curricula. Surely they coukl be rationalised somewhat? 

Rationaiising Existing Courses 

The first stage of this rationalisation was to invite the Great and the Good in each subject discipline 
(in this case technology) to come together and write a set of National Criteria that woukl be 
universally applicable in any technology examination course. There was much blood on the walls 
in these meetings as well rehearsed and deeply entrenched positions were debated and 
challenged. And this was the debate that gave birth in 1985 to a uniquely British phenomenon - 
Craft Design and Technology (CUT). It sought to reconcile craft practice with design innovation 
and technological rigour and in very large measure it succeeded. The CDT National Criteria were 
universally adopted by the new Secondary Examinations Council,^ and all examinattons in the 
technological area had to meet these criteria. 

Broadly, the CDT National Criteria allowed for courses of three kinds in the technological arena: 

• CDT: Design & Realisation - focused on three dimensional product design and 
making 

• CDT: Technology - focused on the design and manufacture of technologica! 
systems and products 

• CDT Design & Communication - focused on the conununication of ideas in 
designing and making. (Secondary Examinations Council 1985) 

A Common System of Examining at 16+ 

This National Criteria exercise paved the way for the second consolidating step - the development 
of a common exan^lnation system at 1 6+, the General Certificate of Secondary Education 
(GCSE) which vias launched in 1985 as the twin systems of GCE and CSE largely disappeared ^. 



5 The Secondary Examinattons Council was set up In 1982 by Pariiament to oversee and take 
responsibility for all examlnatton courses in schools. 

^ They were not actually banned, and GCE courses in particular continued to be used in some settings, 
but their currency was severely undennined and they have largely disappeared. 
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Apart from the revolutionary nature of a single examination for all - regardless of ability - there were 
other ma^r ir-^ivations in this new examination, notably that it should Identify ....^vhat pupils 
know, urxterstand and can do", in other words it was to be criterion referenced. We were going 
to lay out in advance what criteria of excellence would apply, and then measure the extent to 
which they were met by individual students. This stood in sharp contrast to the vast majority of 
former practice that was torgely norm referenced and guided only loosely by mari< schemes. 
Within the GCSE development we therefore subsumed a "XSrade Related Criteria" exercise that 
sought to identify ^'hat qualities were involved at different grades. 

Perhaps the most significant challenge in the development of GCSE lay within the problem of 
differentiation. How is it possible to have a single examination that can usefully be used to 
measure capability from the very slowest pupils to the very quickest and ablest ? The questions 
that one might want to ask this Jatter group n^ay not even be intelligible questtons for the former 
group. Does one - for example - create an incline of difficulty through the paper, such that the 
brighter you are the further you get ? One is juggling here with the effective use of time and with 
pupil motivatton, as well as wfth the content of the subject and principles of educatton. 

Wo cannot beliovd that it can in any way be educationally desirable that a pupil of average ability 
shouW ...be required to attempt an examination paper on which he Is able to obtain only about one 
third of the possible marks. Such a requirement, far from developing confidence, can only lead to 
feelings of inadequacy and failure. 
(SEC 1986) 

Of all the possble ways fonvard in this complex area, the folkwing approaches became 
comnrwnplace in the first rounds of GCSE examinattons in 1986, 87 and 88. In the case of written 
papers, use was comnionly made of 'stepped questions* . Assuming that a question paper has 10 
questions, then each is divided into five subsections which are themselves on an incline of 
difficulty, typically starting with very concrete demands and becoming increasingly 
wnceptual/theoretical. Whilst the best pupils do all the paper, those of average ability might only 
do parts a and b (and possibly c) of each question. In relation to project work it was widely held 
that differentiation could properly arise through the response of pupils to standard tasks. An able 
pupil would do something more interesting/innovative/challenging than an average pupil - even 
though the set task was the same. This becanw known as 'diff erentiatton by outcome*. 

GCSE examinatfon courses devetoped atong these lines through the rest of the 1980s attracting 
wkiespread support. 

• Teachers liked them because of their broadly educational fonmat, 

• Employers liked them for two reasons - because they had only to deal with a single 
system of certification and because the criteria of excellence were explicit, 

• And generally pupils liked them as the confusion of the former twin systems was 
removed, and because GCSE examinattons inherited many of the wore pupil-friendly 
strategies of the CSE system. 

There were doubters of course, and prominent amongst these were the defenders of a more 
traditional academfc curriculum (typically in the remnants of the old Grammar schools) who felt that 
the rigour of former GCE courses had been diluted and that examinatton standards were 
accordingly on the slide.^ . 



7 This debate still nimbles on with the Educatton Minister announcing eariy this year another review of 
GCSE examinatton standards. 
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Nevertheless, by the end of the decade, there were many different CDT courses running^ , and , 
generally in ways that were thought to be highly effective. They all held to the CDT National 
Criteria and were all •* of necessity - scmtinised and approved by SEAC^ . 

The Assessment of Performance Unit 

The APU project in Design & Technology was launched in 1985. A sequence of APU science 
sun/eys between 1980 and 1984 had contributed to interest in technology, partly because of the 
practical investigations that were part of the science APU framework. Furthermore CDT in schools 
was attracting widespread interest amongst educationalists at all levels as well as with industrialists 
and politicians and eventually a scries of manoeuvres Sed to the acceptance of desi{;n & 
technology within the APU rTX)nitoring schedule. 

The brief was to identify the technological capability of the 15 yr old cohort in schools in England, 
Wales and Northem Ireland. At this time. CDT was seen as the core of technology in schools and 
was being studied by approx 35% of pupils^^^ . But this presented interestirig problems for the 
project, for all former APU sun/eys had been in areas of compulsory study - like English and 
Mathematics. We"* ^ were therefore in a position of having to levelop monitoring (testing) 
approaches that provkJed open access for all pupils regardless of their technotogy cuniculum but 
that provided good data on those with high levels of capability as well as on those that had very 
limited experience and capability. We evolved an assessment framewori<. devetoped a series of 
test instalments, ran a pitot study in 1987-8. redesigned the instruments and ran the r^^-ain sun/ey 
in 1988-9 and subsequently analysed the mass of resulting data. The final report on ihe whole 
project (Kimbell et al 1991) was published in 1991 • atong with several supporting pamphlets for 
teachers. These were fed into schools on a regular basis between 1990 and 1992. 

The technical details of the project need not concern us here. The tests themselves • how they 
were designed and what they can [and can't] tell us about pupil capability - will be the subject of 
the 2nd part of this report. With regard to the evolution of technotogy in the currfculum however it 
is worth noting here that the project provkJed three significant steps fonivard. 

First it proved that short tests (90 minutes) coukl be designed that would provkJe good data on 
pupil performance in this area. This is very different from the GCSE kind of testing which involved 
short theory \es\s and extended project assessments over anything up to 12 months. For APU 
we devetoped short tests, but they were not Iheory' or knowledge tests. They were genuine 
capability periormance tests - but in a specif to context and time frame. Moreover we proved that it 
is possible to assess very reliably the pupil responses to these tasks. 

Second we discovered that the core capability in technology cannot be defined simply in terms of 
a body of theorettoal knowledge and an ability to use materials and tools. The data is unequivocal 
and snows that it is - crittoally - the relationships between the two that marks out the excellent 
technologist. Understanding is no use if it cannot be put to use. and practtoal skills are only as 
useful as the mind that applies them in fmitful ways. The periormance data show quite cleariy that 
being able to operate on both levels simultaneously is the key to excellence. The brightest pupils 
(on abstract physical science understanding) do not make the best technotogists - and neither do 
the skilled crafts persons. Technotogy requires a new breed of person who can operate freely at 
the interiace. We were able to klentify such people despite the fact that for the vast majority of 
pupils, and for the vast majority of the time, schooling creates an artif total divkle between the 



^ The old CSE and GCE examining bodies were, reconstructed into regtonal clusters and became 
Examinatton Groups - eg London & East Anglia Examinatton Group (LEAG) and Northem Examining 
Associatton (NEA). Each of the groups drew up their own syllabuses for courses in CDT - but all had to 
meet the Nattonal Criteria . 

9 In 1988. the Secondary Examinattons Council was redesignated the School Examinattons and 
Assessment Council (SEAC). extending its remit to assessment and to Primary schools. 
^0 Approx 60% of boys and 10% of giris 

^ ^ The project was based at Goldsmiths' College. University of London, under my directton. 
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cerebral and the practical. We coined the phrase "thought in action- to describe this quality of 
capability that turned out to be so influential. 

Third, the APU project was sandwiched between the development of the GCSE examination 
system (which was well underway by the time of the APU survey in 1988/9) and the embryonic 
strugglings of the National Curriculum, which in terms of technology was formed by a 1989 Order 
of Parliament (DES 1989). Our major contnlxition to these developments lay in the fact that, 
having clarified that what we were assessing was a new kind of capability [a hybrid of the 
academic and the practical] we also showed that it was reliably assessable. These features were 
irrportant to different constituencies, but together made the further development of design & 
technology politically very attractive to those seeking to reform education. 

The National Curriculum 

it seems Incredible even as I write this, but just as the GCSE innovation was beginning to get 
organised In 1986-7, and as the APU project was beginning to develop new ways of looking at 
capability, yet another far more fundamental shake-up of the curriculum was being launched. It is 
impossible to do justice, in a few paragraphs, to the policy devetopments that led to the 
establishment of the Nattonal Curriculum, so I shall only touch on these lightly and will concentrate 
on the consequences for Technok>gy. 

Broadly, the NC is seen as having ten subjects; English, Mathematk^s and Science as the core 
subjects and seven others (including Technology) in the foundation . Each subject is defined in 
tenns of Programmes of Study (PoS) (that whfch will be taught) and Anammer)t Targets (ATs) 
(that whfch will be achieved and tested)^^ jhese were devetoped by subject wori<ing groups 
whk:h included the Great and the Good in the discipline as well as industrialists and other interest 
groups. The ATs and PoS are anranged across ten levels that are seen to cover the whole of a 
pupil's school experience from 5-16 years (level 2 is average performance for 7 yr olds, level 4 for 
10/11 yr okJs and level 6 for 14/15 yr oWs). Within the ATs, there are numerous Staterr^ents of 
Attainmer)t (SoA) that are essentially the assessment criteria that apply at each level and within 
each AT (see figure next page)34-. 

In Technotogy the definitton of capability is enshrined in the ATs and can cleariy be seen to be 
the offspring of all the eariier definittons - as far back as the 1960s (see page 3). It dominantly 
process driven, the four ATs summarising the activity of designing and making from initial 
understanding of the need, through design and devetopment, manufacture and evaluatton^^ . 
The PoS contain, at each level , the body of knowledge and skills that is to be taught to pupils to 
support this process. 

Whilst the NC definitton of capability is conforming to the tradittons that have underpinned the 
eme^ence of design & technology, the assessment regime is breaking quite new ground. The 
SoA are detailed criterion statements thgit are to be achieved by pupils before they can be 
awarded a level. To that extent therefore they can be seen to derive from the GCSE criterion 
statements. But their mode of operatton is quite new. 

The GCSE system used groups of criteria to help teachers form a judgment of quality. For 
example if a teacher was trying to deckle how good a pupil's evaluatton of her woric was, they were 
supported in the decision by the use of the following criteria; 



^2 The founding document for this stmcture is the TGAT report - the Task Group on Assessment and 
Testing. It lak) out the structure for presenting NC subjects and the mechanisms for testing. 
^3 The Nattonal Cunrfculum subject is called Technotogy". It is contributed to by a range of former 
'subjects', prominent amongst them being CDT. It also includes elements of Home Economtos, Business 
Studies, Information Technotogy and Art & Design. 

This NC definitton Is currently under review again after the first two years of operatton. Some changes 
are to be expected - but this active descriptton of capability will certainly be retained. 
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AT1 

identifying 
needs 



AT2 

generating 
a design 



AT3 

planning 
& making 



AT4 

evaluating 



level 10 



level 1 





At level 7 there are 11 Statements of Attainment (SoAs) that 
need to be achieved across the Attainment Targets (ATs) 

Across ail levels there are 1 19 SoAs 

Review the detail of their design, and suggest aKemative ways of 
achieving what is needed" (DES 1989) 



They make their decision, and (say) 3 marks nrright be awarded. These were then added to all the 
other marks (for investigating, generating kleas, planning, making etc) and thus the whole project 
achieved a mark out of 1 00. 

Within NC assessment, this an^angement has been entirely changed and the 119 SoA are seen 
as indivkkial criteria to be scored - yes or no. To achieve level 4 you need to register a V^s' for 
each of the level 4 SoA - and there are 1 5 of them. 



0 «hMff 

ofafcolMty end is ^MwmoocnpiMc or not dMiQsllwr NrtwMrt 
Muros of PstaWQ^ for IMsr MiMfM 



GSCE evaluation criteria 



This has resulted in teachers - for the first time in my experience - carrying around large tk:k-sheets 
on which to mark off indivklual SoA in respect of each of their pupils. It is a very cumbersome 
system and in a sense it is anti-judgmental. It is not possible (or at least not supposed to be 
possible) to sit back and take a broad view of the pupil's capability. The final overall treasure of 
capability is supposed to emerge from an aggregation of all of the small SoA judgments. But this 
is a very dangerous policy in Technok)gy - as indeed it is elsewhere - as so many qualities of 
capability are not independent but interact with each other. It's a bit like scoring a chikl who is 
teaming to ride a bike and using separate marks for steering, balancing and pedalling. We can all 
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identify that moment when the child's riding takes a leap forward and s/he stops falling off the 
bike, but this critical moment does not derive from an advance in any one of the three bits of 
capability, but rather from grasping their Interdependence, 

Teachers are giving toud (and increasingly angry) voice to the fact that they are being submerged 
under a deluge of tick boxes and fomrj filling, much of which they see to be of dubtous value. And 
moreover the NC assessment arrangements are wWely seen as having the effect of reducing the 
possibility of professional judgment that teachers are used to exerciislng in assessing the 
capability of their charges. This impression is not helped by the fact that the final assessment for 
a pupil emerges from the application of complex formulae to the pattern of yes's and no's that the 
chikl achieves in the SoA. 

Clearty the NC assessment regime is founded on a set of principles to do with strict criterion 
referencing and a 'mastery-testing* model. But the capability it is seeking to assess is exactly the 
same capability that was formerty assessed by other means, and the experience of the last two 
years suggests that a cherry-picking approach to assessment Is not easy to operate and not very 
helpful (either for teachei^ or for pupils) in devetoping an understanding of the qualities 
required. 



1990s 



Technology is now in danger of falling victim to the coincklence of history. Technotogy has 
emerged over the last 30 years into a powerful educational force that has been wWely weteomed 
by teachers, pupils, parents and employers. So much so that it has become a mandated part of 
the Nat tonal Curriculum - a compulsory study for all pupils between the ages of 5 and 16 years. 
This is an enonrrous achievement. Indeed it is a staggering achievement when one reflects upon 
the deeply tradittonal structure of the vast majority of the British curriculum. Raymond Williams in 
his book The Long Revolutton" recounts the devetopment of the curriculum and concludes that 
R is dominantly 19th C, with signiffcant features from the 18th C, and with a mediaeval core. Given 
the sheer tenacity and tongevity of so much of the British curriculum, it Is indeed remarkable that a 
new discipline shoukJ have elbowed its way in over a period as brief as thirty years. 

However, its adoptton into the Nattonal Curriculum made technology a requiren:ent for all pupils 
within all schools. And by a sheer fluke of history, within the same legislatton» the assessment 
arrangements for everything in schools were utteriy transformed. The transformatton has not 
been smooth, and technok^y has become synonymous with the proolems of NC assessment. 

The original descriptton of technotogy by the Nattonal Cuniculum Worthing Group represented a 
natural evoluttonary progresston from the thirty years of devetopment that led up to it. It was 
process-based, task centred, and concerned with buiWing technologtoal capability (see also part 
three of this report). But it has proved to be a very difffcutt beast to assess using the NC 
assessment (tick-box) regime. Whilst all teachers find it diff toutt to fit what they woukJ normally do 
to this new an^angement, technotogy teachers in partfcular are in difffcutties. 

Subjects that can be defined in tenns of strict bodies of knowledge and sets of skills might just be 
amenable to s >ch an approach, but technology represents the antithesis of this. There is more 
than a little po»ential tojth in the quietly spoken despair of a sentor civil servant when he confided 
the view that *1echnotogy might be the rock on whfch the (NC) assessment an'angements 
founder". Whilst technology might be the leading contender in this, the current dispute over the 
testing of English demonstrates that It is. In reality, a wkJespread issue of concern. 

In my experience, when a ship is about to hit a rock, it Is profitable first of all to questton the 
directton of the ship. But until very recently the preferred policy has been to move the rock and 
the immediate target for actton has been the deflnitton of technotogy itself. The 1989 NC 
def initton has been judged to be flawed and a Review Group has been charged with the task of 
making it rVwre •'manageable". And there are perceived to be two sides to this questton; (i) 
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reducing the procedural complexity (reducing the ATs, reducing the number of SoA , and (ii) 
reducing their 'sophistication') and spelling out the content (the body of knowledge and skills). 
Predfctably • given a brief of this kind - the preliminary findings of the review suggest that we might 
be heading backwards. Whilst all practitioners recognise the role and importance of the 
knowledge and skill that underpins technok)gy, it is also wklely understood (again by the 
practitioners) that these bodies of knowledge and skill do not * of themselves - provkie an 
adequate definition of what technology is and how it contributes to pupils education. It is for 
these reasons that the original Working Group drafted statements of the kind that they did .... 

Review the ways in which their design has developed during the activity, Justifying their decisions 
and appraising outcomes in terms of original intentions. 
PES 1989) (NB. this is intended to be suitable for 12 yr okis) 

Of course it Is difffcult to judge such statements as yes' or 'no' as is required by NC assessment, 
though " )achers are quite familiar with handling judgments of this kind with the sliding s<^le GCSE 
system. The Technotogy Review Group feft that statements like the one above are loo complex" 
to be useful. The crude assessment mechanism was creating the need for simplistic assessment 
statements. 

So technology stands at the cfoss*roads. After thirty years of devetopment we are again plunged 
into a fierce debate about the rattonale and educational signifk^ance of technok)gy. 
We have evolved a sophisttoated, challenging and fonward k)oking nxxlel of capability in 
technok)gy. Yet at the same time we are seeking to assess this capability through inappropriately 
mechanistk: means. The two things wouki not fit together and something had to give. 

In May/June this year (1C33) an astonishing event took place. The whole panoply of NC testing 
crumbled in the face of an unprecedented piece of direct actton by teachers. In Uip fCiOe of 
instructtons from the Minister of Educatton - and at one time the threat of legal actton * alnfx)st 
every school in the country simply refused to mn the NC tests. The issue was not merely about 
technotogy, though English and Technology were the most frequently cited subjects of 
aggravatton. The results of this remarkable event have been nunierous but for the purposes of 
this story the most significant has been a rolling back of the unhelpfully prescriptive assessment 
anrangements. 

The Dearing review^^ has recommended in its Interim Report a signifk^ant simpliftoation of the 
statutory requirements of the NC and a major slimming down of the testing regime. In the process 
it appears that the strict criterion referencirig procedures are to be mediated by broader 
approaches with more scope for teacher judjgnient. In short, we appear to be moving back to a 
more flexible pattern of assessment and this bodes well for Technotogy. However, the review of 
the definition of Technotogy is still live' and its conclustons will not be finalised until the Dearing 
review has published its final report later this year. 

It is all still to play for, and the balance of the argunf)ent appears to be moving in a directton whtoh 
woukl altow technotogy to continue to f tourish - with all the educattonal benefits that I have 
attempted to illustrate in part three of this report. 



15 Sir Ron Dearing - a professionally respected person - has been asked by the Minister of Educatton to 
head a review team for the whole of the NC an'angements, including the assessment arrangennents. 
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The Assessment of Performance Unit (APU) 



This part of the report is itself written in three sub-sections. 

• In the first. I shall outline some of the principal Issues that emerged in the 
development of the assessment framework and the tosts. 

• In the second, i shall outline some of the principal findings (data ) in relation to pupil 
perfonmance. 

• In the third I shall explore the longer term Impact of the project on the 
development of poky and pracdce for d^ign & tech^ 

espedaly the UK National Cunicuiun^ 

The background to the estabTishrnent and the princq3^ 

parti. VVSthinthtesectioalshal examine the work of the De^ 

based, under my direction, at GokJsrrtlhs* College London between 1985 and 1991 . We were 

charged wlh inonioring the technotogical capaMity of the 1 5 yr old OD^ 

Northern Ireland. The IjgWsarrping'princfjIe of APU monitoring - in which a 2% sample of pupils 

bused to repiesentthe nation's pupils- was appled as withal other APU surveys, and moreover 

W3 were required to do the buk of the testing tiy post using sho^ 

penc9 test) techniques. 

It is easy to see why we were sonnewhat dubious idx>ut the b^ Pupil capabiity in technology 

geners^y unfolds over an extended perk)d of ^ and - at least in part * th^ 

with materials and tools. We were not. conynncedthst this capabiity could effecfive 

in any reafistic way using short pencil/|paper tests. We therefore developed a three pronged 

assessn)er« frarnework that inked short penci / paper tests wih 

te^y* activlies and we designed a survey that £yk)wed us to cross relate perfon^ 

them. In the end, for reasons that win bea)rneapparert, the short tests provided sonr» 

insights both into the capsdt)iljty of pupils and into the nab 



Issues Emerging From the APU Test Instruments 

We developed a series of approaches to testing that can be categorised into three broad classes. 

90 minute pencll/pap^r tests, in which pupils completed structured tasks, working 
with restricted resources in a specially designed pupil response booklet. Because of the 
degree of external control that we exerted on these tests, and the fact that large numbers 
of pupils were involved in them, this element of the sun/ey provkies the most statistically 
reliable data. However, because of the short time altowed, each task only examines 
certain aspects of capability, (see Kimbell et al 1991 sectton 7) 

Modelling tests, in whk:h a selection of the 90 minute test tasks were supplemented 
with extra time (half a day), a range of soft and rigid nxxielling materials and the 
opportunity for pupils to collaborate in teams. These tests had strong elen^nts of control 
within them, and involved pupil collaboratton and discussion. The sample size for these 
tests was large enough to provide statistk:ally reliable data, but the tests were tun by 
trained administrators who could provide additional illuminative assessments. These tests 
were therefore seen as a bridge between the 90 minute tests and the third branch of the 
sun^ey. (see Kimbell et al 1991 section 8) 
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Extended Project Profiling, In which field worl<ers monitored pupil performance on 
real projects undenway In schools over an extended period, in some cases as lonp as 9 
months. The field workers conducted regular, individual interviews with pupils, U5llectjng 
detailed information throughout the project and building up case records of Individual 
pupil performance. In this strategy, the emphasis was on collecting illuminative rather than 
statistically reliable data. Because the whole pmjectvias scnjtinised, all aspect of 
performance could be monitored and assessed, (see Kimbell et al 1991 section 6) 

The data from each of these approaches was triangulated by having the modelling test sample and 
the project profiling sample also doing selected short tests. 

Despite the obvious differences In these approaches to testing, they were built around a common 
concem for the integrity for the designing, making, evaluating activity. This is most clearly 
evWenced In the project profiling work, but was equally a concem in the 90 minute and the 
modelling tests. It is obvious that a real design task cannot be taken from inception to completion 
on paper in 90 minutes, and it was these tests that provided us with the greatest challenge. 
Nevertheless before explaining how we coped with the challenge - It is important to recognise that 
because of our view of the nature of technology In schools we were committed to performance 
testing - not knowledge and skill testing. And performance testing in Technology means finding 
ways of measuring how well pupils are able to originate ideas, organise their time and resources, 
conceive of alternative possibilities, model soluttons and evaluate them against user needs. 

Not surprisingly, the first and major challenge was to get pupils to the point where they could 
recognise a short test (in a test booklet) as being a design & technotogy activity. They knew they 
were being tested, and we had to find ways to get them out of the "right answer mode of 
response that they were so accustomed to in testing. These problems we classed together as 
being concerned with the need to pfftth(*artMtv running properly in the first place. 
Subsequently - assuming one has generated a good activity and the pupils have produced some 
appropriate responses to the tasks - there are the further consequences concerned with makm 
assessments of their pertonnance. The first group of concerns has natural priority and will be 
dealt with first. 

Getting activities running 

The context of tasks. Real tasks do not exist in vacuo. They exist in real houses or 
gardens or shops of car parks or hospitals, and the setting os the task is a major determinant of the 
meaning of that task. If you wore invited to ^design a door handle" it vwuW have very little meaning 
until you couW see the context for which it is Intended. It might be for a child's play-house, or for 
an industrial kitchen, or a heavy goods vehicle. In each case the Issues that the designer needs to 
consider are to a large degree defined by the context . Equally, the success of the outcome can 
only be determined by examining its operatton in the same context. 

We used a series of 8 minute vkleos to capture the range of contexts within which our tasks were 
embedded: 

a pre-school play-group, 
a post off ice, 
an elderiy lady's kitchen, 
a back yard: 

an industrial productton line, 
and a design studio. 

These settings not only created meaning for the task - they also provided important cues to help 
the pupil to get started on the activity. If asked to design a leaflet storage and dispensing system 
for the post off tee, the vWeo of the post offtee not only fleshed out what that task meant, it also 
provided some potential lines of design devetopment to get the pupils up and mnning on the 
task Who are the users? what do they need? how do thay typically get the leaflets at the moment? 
what problems exist? These practical issues become jumping off point that give access to the 
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task. 

The first critical message torn our testing is that tasks must be contextualised; firstly because it 
provides meaning and secondly because it provides *1arting points for adton. As a research 
exercise, we ran the same tests with and without the liiltiating vkJeo and the results were highly 
slgnlfteant and demonstrated the empowering nature of the contextualising. 

The hierarchy of tasks. Having established a context however, the nature of task setting 
has a serious Infect upon the do-ability of the task. And the most slgniffcant aspect of this lask 
effect' is procedural rather than conceptual. It matters relatively Btde whether the task Is do with 
devetoping a post office leaflet storage system - or a chikte toy. The different content is barely 
significant In determining how well pupils are able to perfonn. But is matters a great deal whether 
the task is set toose/y or tightly. As explained above, we used contextualising videos to set the 
scene for the tasks, and thereafter we set the tasks at a range of levels of specificity. 

1 In some tasks we provided little nrwre than a generalised suggestion that the 
context was full of potential problems that could usefully be pursued by a designer; for 
example Ihink about Issues of protection In this context..." We then left the pupils to 
identify for themselves the specifics of the tasks they might pursue. 

2. In other tests we provided a more comprehensive framewori^ for the task by 
adding more precise demands to it ; for example ."...think about the protection of 
personal possessions from theft. " Naturally, pupils were getting a better 'steer* from us 
in these tests - but still had the opportunity to derive quite disparate tasks within the 
context. 

3 . In the most tightly spedf led tasks we went yet further and added quite specific 
design requirements to their task; for example -....design a travellers body purse..". Here 
was a quite speciffc starting point !hat provkled little room either for negotiatton or for 
confusion. 

As can easily be seen, these three tasks are hierarchically related. 



Contextual task -> Framed task - > Specific task 



And the same stwcture can be applied to any context you care to mention. 

It is easy to understand the differences of demand that exist within these layers of task setting. 
The contextual level provkles plenty of opportunity for pupils to lake ownership* of the task, 
because they are - in a very real sense - deciding for themselves what the task will be. But there is 
very little support in it; it is not clear exactly what pupils shouW get on and do. and it might be easy 
to spend a tong time unproductlvely trying to find a real task to get into. At the other extreme is the 
reverse pr<*lem. It Is quite obvtous what the task is - and hence quite apparent how one might 
Immediately proceed, but it is much more difffcult for pupils to generate any personal ownership of 

the task. What do we do with the pupil whose reaction is " I'm not Interested In, I dont want and 

I dont need a body purse.."? WouW the test then be a fair measure of their capability? 

The big questton of course is how these different layers of task setting affect pupils pertonnance 
on the tests. Before answering it however, the Issue has to be taken a stage further, for the 
question of openness or specificness does not just relate to task setting - it also relates to the 
whole procedure for pui^uing the activity. 

Stnjcturing the activity. Assuming that 90 minutes is available for the activity, it can be 
managed In any number of ways, and our tests reflected this diversity. In some we lett the 
structure veiy open - with large blocks of time available to the pupils and only limrted inten/enttons 
by the administrator to steer the activity. In these tests, average sub-activity times (between 
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intarventtons) would be approx 20 mins. Other tests we structured much more heavily • with more 
interventions and instructions by the administrator. Average sub-activity time here might be as 
short as 10 minutes. 




A hierarchy of tasks 



Again the strengths ar i weaknesses are obvious in retrospect. In tightly stmctured acti*yities 
there is plenty of support and few pupils tost their way in the activity. But by the same token there 
was little opportunity for pupils just to get on with it - as we kept stopping them. In the wore open 
stmcture it is much easier to waste time - or tose one's way completely - but those that were on task 
could get on without interruptton. 

These two design features of the tests • ctosed or open tasks and tight or toose strndures - had a 
marked impact on the perfomiance of different subngroups of pupils. Put very simply, on average - 

• girls perform better than boys on open tasks 

• toys perfomn better than girls on closed tasks 

• p^ipils of tower general ability perform better on more tightly stmctured activities 

• pupils of higher general ability perform better on nrx>re toosely structured activities. 

A further clear finding was that.. 

• the greater ihe experience of Design & Technology that pupils had been exposed to 
in their cunlculum, the less marked these tendencies became. 

It is also interesting to note that the most successful sub-group of pupils in our tests was high 
ability girls who had engaged in a signif toant amount of Design & Technotogy in their currtoulum. 
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The iteration of action and reflecSon . A final major issue in regard to test strnduring 
concenis the balance that Is stmck between active design activity (drawing, modelling, making 
etc) and reflective appraisal of where they were going (Wentifying issues for judgment, kJentifying 
strengths and weakn^ses in the work etc). It tyacame obvious from a very early stage that action 
and reflection need to be kept in balance in any technological activity. Technology is about the 
active pursuit of real problems, but it must be focussed and directed by continuous awareness of 
the needs being niet, the priorities of the users, and the strengths and weaknesses of the work 
so far. And In a technotogical task (as probably in any task) the relattonship between actfon and 
reflection is iterative. Actton forces issues Into the daylight, and those issues then raise further 
directtons and possibilities for action. 

To get a measure of the significance of this phenomenon, consWer then the difference between 
these two test structures for the 'evaluation' test that involved the critical evaluatton of a pair of 
supposedly similar products: 

Test stmcture (a) 

* video contextualising 

- identlffcalton of criteria of judgment for the product 

* examination of the product 

- identifk:ation of strengths and weaknesses of the product 

- redesign to improve the product 

Test structure (b) 

* vkieo contextualising 

* examination of the product 

* design devetopment of a new product to be better than it 

- identlffcalton of criteria of judgment for original product. 

* kjentif fcatton of strengths and weaknesses of original product 

Both structures have the same five elements, but they arise in a different order. And the major 
difference is in the positton of the active designing (stage 5 or stage 3), as opposed to the 
reflective identification and consideratton of criteria, but this has enomious consequences for 
pupil pe.lormance, especially in terms of the richness of the criteria subsequently klentif led as 
important. If you are able to think about these criteria having already tussled with the design 
challenge, then you are more aware of what is important and what is not important. The 
performance data are quite clear on this point, and the interdependence of thinking and doing in 
technotogy enables us to understand cleariy why it is so. (see Kimbell et al 1991 section 3 and 
Kimbell 1991 (b) p 149) 

Over a period of 18 months - during whteh time these various test effects became apparent to us - 
it became progressively more possible to devetop a set of tests that altowed pupils to demonstrate 
creative technotogical capability in a relatively short time and in response to a standard set of tasks. 
Exactly these same issues applied to the design of the modelling tests - whteh were tonger, 
involved the use of real materials, and altowed for elennents of group collaboratton. There were 
however two addittonal strategies that proved to be particutariy important to the success of these 
rrxxJelling tests. 

Pupil discussion in the modelling tests. Pertiaps the most startling outcome from the 
development of the rrKxlelling tests was our realisatton of the role and importance of group 
discussfon. From the eariiest trials we were aware of the impact that it had on the crystallisation of 
design toeas and in the final verston we deliberately set a 20 minute discusston into the mtodle of 
the design &devetopmentpnase of the tests. In turn, each of six pupils was asked to say (in two 
minutes) what they had done, why, and what they proposed to do next. It was then open for peer 
comment around the table - with the chairperson (the administrator) being strictly constrained to 
neutral questtons as prompts if necessary. It setoom was necessary - and in the vast majority of 
cases the interactton proved immensely signif toant in helping pupils forward in their designing. 
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One of our test administrators commented : 

This was a strategy that I had previously not put any emphasis on in my own teaching and I found it 
by far the most useful device for helping pupils extend the!" ideas. Tne pupils' response to each 
others criticism was a major force in shaping the success or failure of the artefact in their own 
eyes. Pupils saw this as a very rewarding activity and would frequently modify the direction of their 
own thinking as a result. {Wmbell et a! 1991 p 123) 

This was a common reaction among the administrators. Even though we had selected the 
administrators on the basis that they must be very good practitioners of technology teaching, 
none of them had prevtously made significant use of this collaborative technique, and this alone 
speaks volumes of the perception of the teaching and teaming regime. It fs so often seen to be 
an individual, personal activity. One of the ctearest message from our nxxJelling tests is that 
opening It up to group discussion in a supportive/critical framework, is highly effective 
improvement strategy. 

The use of materials and resources. The other major feature of the modelling tests 
concerned the use of resources te. materials and tools, and the problem of how to do it. If you set 
a task and then say Ihese are to resources you have to work with" then pupils spend ages 
exploring the resources and often get ted by them Into solutions. We wanted pupils to tead with 
their own ideas and use resources in support of those kleas, and this required a more critteal 
access to resources. We (eventually) resolved thfe problem by setting up a shop - for which the 
test administrator was the shopkeeper - and to which pupils couW come and ask for resources. "1 
want something that will do...." "have you got a cutter that can ...." "I wantapieceof ...." Iiave 
you got anything like The pupils Ideas were leading their access into resources. 

This again proved an inrportant development, preventing dilettante fiddling with things that just 
happened to be there, and encouraging a more critteal mode of access. 

Taken together with several other tess significant factors, our progressive awareness of these 
issues of test constmctton altowed us to design short tenm technologteal activHies to whfch pupils 
were able to respond with flair and convfclfon. The archive of pupil responses Is rich wHh diverse 
and creative work. We were confident that this part of our task was satisfactorily in place • but it was 
only half of our task - for we had then to viotk out ways of making reliable assessn)enls of the 
quality of all this individual wori<. 

Making assessments 

What was assessed. Over a period of 12 nrwnths we devetoped an assessment 
f rameworic that altowed us to reflect an active model of technological capabilfty. This model had 
three dimenstons, concerning at its heart the procedures of designing and making 
(investigating, generating, making, evaluating etc). These procedures however are not there to 
be "seen" except through the medium of pupil drawing, writing, talking, modelling and making. 
You cannot see 'generating' without tooking at drawing and modelling. Generating is a pupil 
intention that can only be interpreted • it cannot be directly obsen^ed in the way that 'drawing' can. 

So the procedures of designing and the manifestations of those procedures fomi the first 
two dimenstons of the framework, and these were supplemented by the third dimenston - the 
conceptual understanding upon which the the designing depends, eg of users, of materials, 
energy systems, arKi aesthetics. 

Having Wentified the elements of the framewori^ however, it is vital to recognise that they cannot 
work in isolatton. We were not interested in drawing skills for themselves - or abstract 
understandings about materials. There is a worid of difference between on one hand hoWing a 
concept of electrical power or a skill in pers^actlve drawing and on the oth jr hand being abte to 
use these understandings and skills to some purpose. And procedural, technotogtoal capability 
lay at the heart of the matter, ;or it is the driving purpose of the task that prevents conceptual 
understanding being merely intellectual detritus, and manifestatton skills (eg drawing) being 



merely organ grindirtg (suitable for house trained monkeys) . Totally incapable people (in 
technology term; ) may hold a rich variety of conceptual uncierstandirig or communicative facility. It 
counts as nothing if the two cannot be welded together an i used purposefully in a task. 



Concefituit 
understandings 

-materials 
-tools 

• energy systems 

• aesthetics 
-users 




Procedures 
designing & 
making; 

- investigating 
• generating 
-developing 
-planning 
-making 
-evaluating 




Manifestations 
of designing 

-drawings 
- discussions 
-models 
• prototypes 
-products 



Assesssment framework 



It became ever more apparent that the relattonships between these three dimensions of the 
framework were vital to capability, and yet we recognised that assessnient strategies have 
traditk)nally divkied them. Conceptual understanding has typk:ally been tested in passive, 
written examinattons and communk:ative facility through ck)sed*ended drawing or practk:al tests 
of vanous sorts. For APU, the k>gk: of our positton forced us to reject this diviston and devise 
new approaches. Oir view of capability demanded that we shouki not be interested in what 
students know, or what skills they possess, but rather in the extent to whk:h both of these can 
be used purposefully in a task. All our test^^ were therefore task-centred and devised in ways 
that enable students (in a very short time) to get inskie the demands of the task and display their 
capability in using and extending their understandings and skills. 

Generating evidence. The first key to effective assessment is to ensure that there is 
adequate and appropriate evidence upon whrch to base judgments. This issue lies at ti^ie heart of 
test stnicturing, for the demands that are placed in the test are those that will provide the 
evkience upon whk:h the judgments are to be made. It may help to have one of the tests 
unpk^ed - to see the range of evidence upon whk:h it is possible to get sorne leverage. 

The ''Devek>ping Soluttons' tests were designed to examine how well pupils coukl develop and 
detail a solutton - given a clear brief and a half devetoped 'concept OKXier of a solutton. The test 
involved the foltowing sub-tasks: 

1 video contextualising 

2 /nfrocfucf/on to the task 

3 jot down early ideas about the woridng of the concept nx>del 

4 list the issues that the final product has to address if it is to be successful 

5 kJentify strengths and weaknesses in eariy kleas (in 3) 

6 devetop details and woridng arrangements of the product 

7 identify the areas of function still to be sorted out 

8 reviewXhe wort< in relatton to the task as set (in 2) 

9 kientify the things that you need to find out more about to finalise the de<;ign 

NB. the major bkx:ks of time are in secttons 3 and 6. 

This test statcture provkles evkJence of a wkle range of capabilities and our approach to the 
assessment of these capabilities can readily be sho\^ through sub-task 4. 

list the Issues that the final product has to address if it is to be successful. 
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in any design task there are a range of issues that bear upon the design solution and that can 
readily be categorised, eg.... 

safety 
ease of use 
aesthetic 

packaging & marketability 
cost/price 

manufacturing & assembly constraints 

Pupils are asked, in sub-task 4, to klentify the range of issues that they see as being appropriate 
to their own early kleas for the solutton. In their responses it is easy to see any bias that pupils 
bring to this sub-task. Typtoally they might prioritise elther\he human issues (ease of use & 
aesthetto) orthe technk:al issues (manufacturing, assembly and techntoal functton). It will not be 
dtffk^tt for the reader to predict the gender split of these characteristic posittons. Capable pupils 
however, recognise the whole spread of issues and are able to scmtinise their product 
devetopment through this diverse spectrum of concerns. 

But we must remember that this is a performance assessment - not a memory test - so it is not 
good enough simply to list the issues and walk away. It would be all too easy to coach pupils into 
such responses. A key questton therefore is whether * having listed an issue as important * they 
subsequently deal with it in their designing. 

Mapping and judging. This sub*task 4 also illustrates another important principle of 
performance assessment - to do with the separatton of what we came to temi Snapping" from 
ludging-. In the context of any parttoular task the fet of issues that might be relevant is potentially 
very tong - and we realised eariy on that it was quite inappropriate to use counting as a measure of 
quality, it was more important to ensure that the spread ot issues was appropriate rather than to 
count the number. We therefore mapped the Mentified issues onto a matrix to ensure coverage 
and made a judgment about the spread in the context of the specif tos in the task. 

This same principle was used in all secttons of the test. In sectton 6 for example * where pupils 
were devetoping the worthing arrangements for the product - we were very interested in the modes 
of communication that pupils used. Dkj they use orthographto or isometric rr pknographic 
techniques, did they use notes and jottings, did they use formulae or any kinds of mathematk:al 
modelling, etc etc. Again, the list of techniques that they rtHgtit have used is very k>ng and none 
of them in itself is any sure measure of quality. It is none the less interesting to map what 
\echnk)ues they used whilst making a judgment about how well it enabled them to do what they 
were trying to do in design terms on the task. 

The limitations of algorithms to explain performance. The foundations of our assessment 
poltoy were not imposed at the start, but grew out of our attempts to make effective assessments 
in each of the spedf tasks. It became ever more evklent that there was no simple relattonship 
between things that can be ticked off from a list, and the judgntents that we were waking about the 
quality of the wortc. Sometimes a comprehensively ficked matrix wouki coinckle with high quality 
woric and sometimes it woukln't. Sonietimes a piece of wortc that led to a relatively sparse matrix 
wouki be independently judged by three assessors as of the highest quality. It became quite plain 
that performance assessment in technotogy cannot be left to the blind applicatton of algorithms. 
At every level we came to the conclusk>n that such algorithms can be used to supplement and 
enrich judgments but not to make them in the first instance. It is clear that here are different ways 
of beirfg technotogtoally capable. 

We were drawn to a positton in which wo had to reject the kiea that judgments of overall 
technok>gk:al capability can be aggregated up from smaller judgments. We were able to evolve 
an alternative strategy that was built on an initial holistk: judgment of excellence foltowed by 
diagnostic teasing out of strengths and weaknesses. In each individual case the combinatton of 
strengths and weaknesses helped us to understand why the wort( was excellent, but there was no 
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universal formula that worked reliably the other way around. 

The outcome of all our deliberations was a three stage assessment regime. 

step 1 The pupil's response was judged - holistically - on a 6 point scale of 0-5 
step 2 The 1 4 major sub-sections of the response were judged on a 4 point scale 
step 3 Descriptive matrices were compiled to portray the nature of the response. 

Before committing ourselves to this policy, we explored in some detail the strategies and 
consequences of holistic assessment and - as a result - developed a comprehensive training 
schedule for maricers. This involved analysing a selected variety of pupil woric down to Its 
constituent parts and putting it back together in a number of ways. We were able, in four regional 
one-day training sesstons. to provide neariy 1 1 2 mari<ers witii the necessary understandings and 
experience to complete the exerdse with good reli2a)Ility. This was - quite property - an arp^i in 
whfch we were being particularty closely monitored by the Department of Education. The ujal 
reliability statistics show a median inter-mari<er oonreiation of .75 on the overview holistic judgment. 
(Kimbell et al 1991 p132 & appendix 9.3) 



A Synopsis of Pupil Performance Data 

It is almost Inr^ssible - not to mention misleading - to attempt to Isolate individual influences on 
perfomnance as there are so many and they are generally closely Inlen'elated. When looking (for 
example) at gender effects on capability, It is very difficult to Isolate It from the test structure effect, 
context effect, and task effect, not to mention the effects of ability and curriculum experience. 
Nevertheless, it is useful to tease these effects apart as far as possible, and having done so the 
following general trends emergens . 

The test structure effect on gender groups. I have already indicated the importance of 
maintaining the balance between active and reflective elements of performance. Nevertheless, 
the organisation of the dominant domains of testing produced tests that were either broadly 
reflective or broadly active. In summary. Starting Points and Evaluating Products were 
dominantly reflective, and Devetoping Soluttons and Modelling were dominantly active. The Early 
kleas test is the most balanced of the test forms. 

There Is a remaricaWy close associatton between this analysis and the performance of giris and 
boys. Generally, giris do far better on the more reflective tests than boys, and boys do somewhat 
better than giris in the more active tests. In other words, flirts appear to be better at 
Identifying tasks, Investigating and appraising Ideas, whilst boys seem to be 
better at generating and developing Ideas. 

However, there are other factors about these tests that make this straightfonward association a Tittle 
less simple. I have outlined how the test stmctures can be analysed in terms of their procedural 
tightness. Broadly. If we divkJe the 90 minutes of activity into lots of 5 minute slots - each with a 
separate, but linked, demand - then the stmcture Is very tight and leaves little room for pupils to 
organise the activity for themselves. By contrast. H we divkle the 90 minutes into only 4 stots of 20 
or 30 minutes, there is much more space in the activity for pupils to operate autonomously. This is 
a much looser stmcture. This was not something that we were consciously manipulating al the 
time, but rather something that we became increasingly aware of as we obsen^ed pupils doing the 
tests. 

Interestingly, if we put the tests on a continuum of reflective/active, the order is paralleled by that 
for procedural tightness/looseness. Evaluating Products and Modelling are - on both scales - the 
extreme cases, and they reflect very closely the gender difference we outlined above. On the 
basis of our tests therefore, ft is diff teult to deckle whether the gender effect is caused by the 
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reflective/active axis or the tightness/looseness axis - or by both. But whilst it is difficult for us to 
distinguish between (and quantify) these major influences, there can be no doubting that (either 
separately or together) they are having a serious effect on the performance of girls and t)oys. 
However, if this gender effect ap|3ears generally to hold true, it gets quite dramatic when the 
gender groups are split according to their general ability^^ . We start then to get an inkling of the 
relative importance of the two influences. 

Adding general ability into the equation. The cmcial issue here is the perfomnance of low- 
ability pupils, and the ways in which the test stmcture (reflective/active and procedural 
tightness/tooseness) influence these pupils. We should emphasise that these pupils are not 
necessarily poor performers in design and technology terms, but rather those judged unlikely to 
get many (if any) schooMeaving examinatton passes. 

A major pattern emerges in relation to the performance of tow ability girls, certain test structures 
appNearirig to be far more supportive than others. The diagram shows the distance between the 
ability groups for their holistic scores. Because it is the distance between the groups that is of 
interest, the mid or average ability pupils are taken as the group against which the high and low 
ability pupils are measured and are represented by a zero score. The test structures have then 
been ordered by the relative performance of the low ability girls giving the Modelling tests (in 
which their perfomnance is most depressed) at one end, and the Evaluating Products tests (in 
which they come ctosest to the other girte) at the other. 

There is a clear effect at work here. As we saw above, the tests at the opposite ends of this chart 
are complete opposites in their stmcture; the Modelling tests being the most active and the most 
loosely stnjctured, while the Evaluating Products tests (4A,C &E) are the most reflective and the 
most tightly stmctured. The combined effect on tow ability girls is enormous. It is worth pointing 
out here also that tests 3i and 4 (where the tow ability girls are performing at their best) provkle the 
most concrete starting points for pupils - the 3i tests providing a 'concept model' of how an klea 
might work, and the 4 tests provtoing real objects to be evaluated. 



^ HIGH ABILITY GIRLS - MID ABILITY GIRLS LOW ABILITY Q\ liS 




•1.2 



Mod Mod Mod 1A 1C IE 2A 2C 2E 3iiA 3iiC 3iiE 3IA 3iC 3iE 4A 4C 4E 
ACE 



The performance of girls in relation to test structure 



14 We asked schools in the survey to supply a range of infonnnation on the pupils • including their "general 
ability" based on predictions of their performance in the school-leaving GCSE examinations. 
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There are clear niessages here about the sort of strategies that need to be acJopted to help girts 
(and especially low-abllity girls) to perform well in design & technology tasks. And the messages 

are generally not about the content of the tasks but about the ways in which tasks are 
stnictured to support their performance. 

In the case of boys, there is a different set of messages. If we examine the performance of 
hIgh/mkWow ability boys on the same chart some quite obvious test structure effects emerge that 
are entirely consistent with our prevtous analysis of the effects of test stwdure, and it suggests 
that boys prefer a more open and active structure to activities. Such is the extent of the gender 
imbalance in the Evaluating Products tests, that the tow ability girls almost outperfonn the high 
ability boys. 

But a new factor enters the equatton here as pupil perfonnance varies considerably within test 
staiclures but across contexts and it is to this that we must now turn our attentton. 

ne context effect on gender groups. Broadly speaking, the context effect is such that 
girls tend to out-perfonn boys in the contexts focused on people (eg. designing toys for children) 
whilst in the rest of the matrix the results are rather less clear cut. There is a tendency for boys to 
do better In the /nrfusfrfa/ context (eg designing for productton), but this effect is heavily overlakJ 
by the test structure effect discussed above. The context of environments (eg designing Post 
Offtoe leaflet distributton system) wouki seem to be largely gender neutral. 




In general, this effect appears to be acting both ways, such that the girts get worse in E and the 
boys get worse in A. Again however, the effect is more martced when the sample is spirt by ability, 
and the extreme cases of this arg cleariy observable in the tow ability groups. If we took, for 
example, at the tow-ability groups in Mod A, Mod C and Mod E we find girts perfonnance dipping 
martcedly in E and boys in A. This dip is of course relative to the mto-abitity group and not 
necessarily an absokJte difference. But when we examine the absotote figures we find a steadily 
increasing disparity across the three cor^exts. 

Remember though that Modelling tests (being active and loosely stmdured) generally favour 
boys, and if we took at the reverse case in test 4 Evaluating Products, whtoh generally favours 
girts, we find that exactly the same pattem appears in reverse. Here In context A the girts are 
much better than the boys whereas in contexts C and E the performance difference progressively 
reduces. 

As a general mie it wouki appeat that the context effect is less martced for higher ability pupils, 
suggesting - as one woukl expect - that more able pupils are less affected by the details of the task 
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and are more able to generalise their capability. 

The task effect on gender groups. I have explained how tasks can be located on a sliding 
scale of open-ness and closed-ness. and the more one moves through our test matrix from test 1 
to test 4 the tighter the tasks become with proporttonately less room for pupils to negotiate them 
for themselves and devetop a sense of ownership. Generally, the more open the task, as in 
Starting Points or Eariy Weas, the better the giris perfonn. Much tighter def initton, as in 
Devek^ing Solutions or Modelling, appears to favour boys. 

However, this trend woukl be difffcuK to separate from the other general trends conceming the 
structure of the task, and there are instances where the general trend has been completely 
overturned . As we have seen, in context A, girts generally outperfonn boys - even In the tests 
where the stmclure of the activity is more supportive of boys (as lor example in 3iA and Modelling 
A). How then do we explain the case of 3iiA, where the results suggest almost total dominance by 
the boys. In this case, the conceptual demands that are built into the task (priorftising mechanfcal 
systems) has seriously affected tne pertonnance of gender groups. 

The interacting effects on gender groups. It Is difffcult to tease apart the separate effects 
when in reality they aU exist all the time in every test. Accordingly, performance in test 1 A (for 
example) has a test structure effect favouring giris, a context effect favouring giris, and a task 
effect favouring giris. Not surprisingly the giris did very much better than the boys. 

Conversely, in test 3iE, there was a test structure effect favouring boys, a context effect favouring 
boys and a task effect favouring boys, and they accordingly dW very much better than the giris. 
Wherever the effects that we have described above overiap and operate to the advantage of the 
same group, then we must expect that group signiftoanlly to outperform other groups. Only 
occastonally of course, do the effects all operate in the same direction. More often, if one effect 
operates In favour of one group this is balanced by a different effect favouring other groups. The 
total effect then Is to reduce the gender bias in the results, and there is no signiffcant difference in 
holistic performance between giris and boys. 

One is led to the somewhat sinister concluston that it woukJ be possible - given an understanding 
of the nature of these effects - to design activities deliberately to favour any partfcular nominated 
group. More positively, it wouW also appear to be possible to design activities that largely 
eliminate bias or at least balance one sort of bias with another. It must be a matter of great 
inportance for teachers to attain such a lack of bias (or at least a balance of bias) in designing tasks 
for pupils - or in negotiating them with pupils. 

•Rear in mind that the context of the task will affect how It is received and understood - 
. .nd particulariy so in the case of tower ability pupils. 

•Bear In mind that the details of the speclfte task - and particularly its 'open-ness' or ' 
ctosed-ness' , and the conceptual demands that it makes, will affect the ease with whteh 
pupils can deal with the task. 

•Bear in mind that the procedural structure that you buikl into the activity, partkujiarly 
the active/reflective balance and the lightness* or 'tooseness' of the stnjcture, will 
seriously affect pupils' ability to get to grips with the task. 

The effects of curriculum experience on performance. By examining the pupil data from 
the sun/ey it was possible for us to kJentify the curriculum followed by the whole test sample. We 
then used this to see to what extent - and in what ways - a background in Technok jy appeared to 
be supporting (or not) good pertomiance.^s 

In relatton to the context effect it woukl appear that experience of CDT tends significantly to 
reduce the variatton in pertonnance across context. Pertonnance woukl appear to be much more 



^5 The dominant technotogy experience in the currteulum at this time was CDT - Craft Design & 
Technotogy, and It Is data in relatton to this sub-sample that is refened to here. 
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consolldaied and transferable. In 3iA (the people context), where girls tended to outperform 
lx>ys the boys who take CDT courses perform significantly better than the boys in the control 
group. Similarly, in 3iE (the industry context) where girls typically did not do well, the girls on CDT 
courses outperform the girls in the control group. 

In relation to test structure, the effects of curriculum experience impact just as strongly. There 
is for exarrple a tendency to reduce dramatically the gender effect that typically operates to the 
detriment of girls in 'open' and 'active' teste like Modelling and the CDT group in particular appear 
significantly to outperfomfi the control group. 

In overall tenris, the CDT group consistently outperforms the control group. For boys, all 
categories of the assessment show better performance by the target group, and often it is a 
signlffcantly better performance, interestingly however, the strengths Wentified in 3iA appear as 
often as not to be greater strengths in 3iE, suggesting a robustness about their perfonnance that 
canies them through the unf amiliarity of the context. 

The situatton for girls is only slightly different. Their out-perfomiance of the control group is less 
marked than that of the boys, but the pattern across 3iA/E is almost klentfcal to the boys. The 
pattern of perfonnance is virtually kJentical across the two contextsAasks 

m the modelling tests, the general trend of the results again shows this group outperfomr;ng the 
control group. However by far the most startling aspect of these results concerns the perfonnance 
of girls, who, especially In modelling test C, totally outperfonn the control and almost always (12 
out of 17 categories) at a level of significance. In the principal assessment categories they always 
significantly outperform the control group and only in the less caicial areas is their dominance 
somewhat less marked. 

One cannot help comparing these data with the 90 minute test data, for there we found that their 
out-perfonnance of the control group was less marked than in the boys case. Here we find the 
reverse, with the CDT girls totally outperfomfiing the control group. Whilst recognising that some 
of these data are from a different context (Modelling test C), It would appear that the modelling 
fonn of the tests has altowed the CDT girls to demonstrate far greater command of the task. There 
is a further points to be made here however, for not only do the CDT girls dramatically outperform 
their control group, but they also outperfonn the boys CDT group! This again flies counter to the 
bulk of the data whfch suggests that boys are generally outperfomfiing girls in the Modelling tests. 
It appears not to be so when the girls have done a CDT course, which in turn suggests that girls 
benefit proportionately more than the boys from such courses. The strengths (dominantly 
reflective) that girls typically bring, when linked to a CDT course that typically (from the data) 
enhances active capability, creates a combinatton of strengths that altows them to achieve high 
levels of perfonnance - whk:h show up partk^ilarfy well in our Modelling tests. 



The Contribution of the APU Design & Technology Project 

Influencing the fonn of NC Technology. In analysing the contrlbututton of the APU 
project, one needs to remember the time frame within whfch It was set. As we were devetoping 
our assessment framework in 1986, the first moves were being made to draw up the National 
Curriculum. As we published the results of our pitot sun^ey in 1987, the Working Party to define 
Design & Technotogy in the Nattonal Curriculum was deliberating and taking evkJence. As we 
moved into our main sun/ey in 1988 the Working Party produced its Interim Report. In tooking for 
our contributton to the principles of assessment therefore one must first took to see how we 
Influenced the writing of the Technotogy Order In the Nattonal Curriculum. 

One does not need to took far. Our basto battery of 90 minute tests was constructed around a 
four stage description of the activity: 

test one Starting Points 
test two Early Ideas 
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test three Developing Solutions 
test four Evaluating Products 

The National Curriculum framework was based around four Attainment Targets: 

ATI Identifying needs and opportunities 

AT2 Generating a design 

ATS Piannirtg & Making 

AT4 Evaluating 

Established practice prior to the APU project woukJ have centred on Designing and Making le 
AT2 and AT3. It Is likely that our wort; influenced this four AT structure, in partkxilar in relatton to 
the importance of the activity being real in the sense that it derives from a need or opportunity of a 
client group (ie ATI). 

For exannple.. 

• We design a new leaflet dispenser for a Post Office not just because the teacher sets it 
as a task - but because we have seen that durrent systems are patently failing. 

• We design a new storage unit for the pre-school play group not just because teacher 
says so - but becaase we have seen that their current arrangement can be radically 
improved. 

As I have explained above, in our tests we had to made vkleo to establish the reality of these tasks, 
but teachers are in a far stronger positton to estsd^lish this reality. This is not to say that all activities 
must derive from needs Wentif led by pupils - or that teachers must not set tasks. It is merely to 
point out that in an/ technotogy task (whoever sets it) pupils need to work out who the client is 
that they are designing for and what their priorities are. 

Influencing the role of context. A further influence of APU thinking relates directly to this. 
Our tests (published in 1988) were contextualised through vkleo. and we used six contrasting 
contexts within which we were able to establish dramalfcally different kinds of technology task. 
Prior to APU, little reference will be found In the literature to the role of context. The vkJeos 
proved a great success with teachers, and not simply in terms of enabling them to run the tests. 
After the sun/ey, we were Inundated with requests for copies of the videos whteh teachers wanted 
to use as contextualising niaterial for their normal technology projects. 

In the foltowing year, and pertiaps not surprisingly, the NO Technology Order made the role and 
the Importance of •^context" quite explicit. 

Wo place much Importance on pupils* design & technology activity being undertakon In a variety of 
contexts and spocrfy what we have In mind by reference to home, school, community. 
Industry (DES 1989 para 2.17) 

There were at least two diniensions to this development. 

1) Teachers were being encouraged to help pupils to derive design & technology tasks 
from the reality of their daily lives. This might not seem a particulariy dramatic development 
- but it was in fad an enormous step to take. Whilst it would have been relatively 
convnonplace in project woric for 16 yr okJs. it was unheard of for younger pupils and 
teachers found this adjustment very difficult. 

2) The consequence of (i) above was that teachers found ther..wdlves managing tots of 
individual projects for younger pupils where formeriy they would have set class projects. 
The problem that many teachers grappled with was how to constojct a feach/ng course 
when the focus of projects was in the hands of pupils. 
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In reality the problem stemmed from a lack of preparation of the teachers for this radical 
developmertie . No one questioned the desirability of basing tasks in real contexts, but the only 
experience teachers had of doing this was the ways it is done for 1 6 yr oWs where it was commonly 
interpreted as an open chotee of prelect. There Is no reason why this shouW work for all pupils - 
particularty when teachers want to use projects to teach particular things. In fact there is no 
contradictton between the teacher "setting" tasks and using real contexts. " K the teachers sets 
a task to do with designing a new house/environment for the class hamster or rabbit or the chiW s 
pet at home it can be a task that is suitable for all pupBs - but which Individuals can taitor to the 
particular Interests/needs of their own pet. Such aoangements altow teachers to corrtrol the 
teaching agenda - whilst altowing pupils to personalise it to their own circumstances. The teachers 
can conf klently introduce concepts of ergonomfcs - for example in relation to the size of the ariimal 
and tts eating consumption - safe in the knowledge that it will be a common requirement even if 
Jane does keep rattlesnakes and Peter has a parrot. In many schools this good practfce became 
the norm - but in too many schools teachers threw open the gates of choice, in effect abdicating 
responsibility for control of the teaching programme. 

One of the legacies of the APU contexts therefore has been a heightened debate about the role 
of context in design & technotogy teaching. Contextualised tasks are patently a good thing - but 
they need to be nwinaged with a degree of teaching subtlety that Is not required when such 
contextualising Is not seen as important. In practice, the debate has polarised performance; with 
the best teachers grasping the opportunities and moving fonward with a new tool in their teaching 
toolkit, whilst others suffer disorientation in their teaching and then revert to more traditional sate 
practtees. To support this debate, we produced a booklet for teachers^ derived from our test 
programme and showing how contextual tasks can be sef at different levels of specificity - 
altowing pupils greater or less room for manoeuvre in personalising the task. Contexts are 
enormously empowering for teachers and pupils alike, but they need to be used with professional 
care and expertise. 

Establishing the Iteration of action and reflection. Technotogy has for years suffered from 
an artiffcial separalton of 'hand' woiK and 'head' work. As I pointed out eariier, one of the major 
elements in the success of the test activities we devised lay in our reconciliatton of these two in 
ways that were nrwtualty supportive. For example if you wish to evaluate the effectiveness of a 
product (essentially a 'headwork' task) we have shown that pupils can do It far more effectively 
when they link it to an activity that requires them actively to try to design a better one. The act of 
doing the active designing raises enormously the awareness of what is needed - and hence the 
level of reflective criticality that is applied to the existing product. 

Such was the impact of this finding that it wouW appear to have had a major impact on the 
perfonnance descriptors used in the NC Technology Order to define excellence. At almost every 
level in the Order, one finds perfomiance statements that necessarily require pupils to Integrate 
reflective with active pertonnance. For example... 

level 2 (age 7) 

• Use pictures drawings, models to develop their design ....giving reasons tor why 
they have chosen certain ideas (action»»reflection) 

levels (age 12) 

• Appraise thfl outcome in terms of the original need and how it might be improved 

(refl9Ctioft»»action) 

level 7 (age 16) 

• Review the detail of their chosen design and suggest alternative ways of 

achievifig what is required. (reflectior)»»actioft) 



■•6 There was a very limited nattonal In-Sen/toe teacher devetopment programme 

1 7 The APU tests atone shoukJ have shown this. The contexts were rich but the resulting tasks were very 
tightly stmctured. 

1 8 -Negotiating Tasks In Design & Technotogy" HMS0 1 3744 SE AC 1991. 
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In all these cases (and rnany more), the requirenient is to set practical action against thoughtful 
reflection, and this is the first time such balanced requirements have appeared in the assessment 
literature for design & technology. Teachers have responded very positively to this development. 
They have not only grasped the opportunity to Improve their students performance but are also 
publicly delighting in the recognition that designing makes serious cognitive demands of pupils. 

Expanding understanding about what is testable. The APU research exercise 
undoubtedly contributed to a transformation of opinion about the nature of testing In technology. 
The tradition of testing and assessment in technology has been that one can assess capability on 
extended projects (over several weeks) - and one can test knowledge and skill in short tests, 
Long4erm project assessment however, has always been subjected to a number of crilidsms; rt is 
time consuming and expensive and without a tot of investment in cross-moderatfon processes rt is 
not reliable for nattonal testing. Inevttably therefore too much reliance is placed on the alternative 
mode * pass^^e written examinations of knowledge. 

The APU project provided an attemative. We established that it is possible to constaict tests of 
performance and capability In technology that genuinely do measure how well pupils are able to 
make use of their knowledge and skills In tackling real tasks. And we were able tQ establish that 
these tests can be administered consistently and that the resulting work from pupils can be 
assessed reliably. It is not surprising therefore that when the Department of Educatton sought to 
establish NC tests for all pupils on a year by year basis, they commissioned this research group to 
the extent the messages of the APU project and aeate a set of tests for Technotogy In the NC at 
age 14. As ft turned out. the advtee we offered on the matter was not thought to be appropriate. 
Our work was suspended and developments took another course through a different agency. 
The subsequent collapse of the NC testing regime thfe year - in whfch the vast majority of 
teachers in the UK simply refused to administer them to their pupils - is now a matter of record, it is 
wWely attributed to an kleotogically driven anti-intellectual polrtteal agenda Increasingly out of 
touch wrth the needs and aspirattons of schools, and Technology was In the front line of this 
debacle. Whilst the ultimate revolt was significantly greater than anything one might have 
predicted, the limitattons of the tests that were being imposed were manifest not just to 
researchers but equally to teachers and pupils. 

As a result of this bmising experience, preparattons for the further development of Technotogy 
and tts assessment in the NC are entering calmer waters in whfch rt wouW appear that research 
evklence will be altowed to make rts conlributton. tt woukJ be surprising if some of the more 
obvtous issues to whtoh this research project has drawn attentton were not translated Into the new 
generatton of NC assessment strategies. 

Understanding design & technology. Ultimately however, whilst this research project has 
been about assessment - rts most enduring conlributton wili not (I predict) be about assessnr)ent. 
tt will be in tenro of the deepening of our collective understanding about the nature of the beast. 
As we pointed out in our concluston to the research report; 

To tackte the assossmont of perlormanca ono needs first to say what constitutes 

portormance both in principle and in practice Accordingly we have embraced in our 

endeavour issues of educattonal principle and pedagogy and moreover we have sought 
to re>'(ect these in our analysis and presentation of the resulting survey data. We would 
hope that teachers will see this as a curriculum research and development project as 
much i\s an assessment project. Indeed rt Is the first of rts kind In design and 
technology. We hope that its results will be seen as much in terms of informing the 
nature of teaching and learning in design and technotogy as In providing base line data on 
pupil performance. In any case, the two are. as I hope we have shown, intimately 
related. 

(Kimbeyinal 1991) 

As I outlined in part 1 of this report, there continues to be a heated debate about the role and 
technotogy in the cunrtouium. Wrthin this debate there are very few fixed points of reference to 
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which one can appeal and one of these points of reference is the methcdoiogy and findings of the 
APU project. I believe it to t)e a realistic assessment that we have canied forward the delate about 
the nature of capability in technology and the contribution it can make to the development of 
young people. 

This is the richest and most critical debate, and it is to the one to which we must now turn. 
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Learning through Technology 



Three Models of Technology 

There are several ways of looking at the nature of learning in Technology, and a useful approach is 
to analyse the experience in temns of the following three styles; 

Awareness of technology 

This involves a historical, sociological, economic, even philosophical study of the impact ot 
technology over given periods of history. How (for example) did the development of 
bridge technology affect the placement and development of communities ? Why (for 
example) did the evolution of iron smelting take place where it did and how did it influence 
the devetopment of society. Such studies are typically backward kxjking - reflecting upon 
what has happened in the past. The more adventurous courses of this kind seek to 
project f onvards to what might be the consequences (for example) of gtobal 
telecommunications, or non-lntaisive surgery, or cars that can steer themselves from 
cables buried in the road. There is a massive literature to support such approaches, 
typfcally categorised as "History of Technotogy" , and some very good materials have 
been devetoped specifk^ally into course materials for schools. 

These kinds of study do not require in-depth technotogical treatment as their priority is to 
contextualise technotogy into wider issues of human society. The common feature of 
these kinds of courses is that they treat technotogy as an accumulating set of magto l)Iack 
boxes" * that can do clever things. In order to get started, you have to accept that satelites 
do X or that suspenston bridges do y without really knowing (and perhaps without really 
caring) how. 

Competence In technology 

This is the absolute opposite of the 'awareness' course. It is essentially a 'hands-on* 
course that is not only designed to get into the nitty gritty business of how things woric, but 
nx)reover is designed to enable course members to become conrpetent in making them 

ViOtk. 

This concrete focus almost inevitably results in nighly specialised course stmctures. You 
can leam about - and become competent in - electrics, or mechanfcs, or lasers, or 
pneumatics, or integrated circuits, or programming, or whatever. Because of the depth of 
understanding and experience that is typically involved in such courses, there is not time 
to span very far across the fiek) of technologtoal endeavour. Courses are specialised and 
specitk; and lead to competent electricians or mechantos or programn)ers. Where such 
courses have been developed for use in schools (eg with 14 yr olds in the UK) they are 
almost always modular - with separate modules in a range of specifk: competencies. 

If 'awareness* courses are a bit suspect in their grip on technotogk^al reality, then 
'competence' courses suffer from the reciprocal difficulty. They tend to take for granted 
th^ technotogy is simply Ihere' to be engaged in and - almost by extension - is inevitably 
therefore a good thing. Technology is not seen as a powerful influence on the structure of 
society - but rather as a branch of applied science. 
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Capability in technology 

This is an entirely new phenomenon that is the outcome of thre.. decades of development 
m the UK. It is not a passive intellectual study like the awareness courses, and neither Is it a 
nanrowly focused competence course. It is based on the process of design, development, 
manufacture and testing of new things; these Ihings' being broadly categorised as 
products (eg chairs), systems (eg. of traffic flow) or environments (eg motor-home interior). 

Competence courses typically focus on these classes of outcome and then generate 
bodies of knowledge and skill that surround them. Capability courses by contrast focus on 
the process of deriving outcomes and this process involves a unique blend of the 
intellectual and the practk:at. 

In the first two of these schools of technological thought (awareness and competence) there is an 
obvtous liaison to contrasted sectors of the cuniculum. Awareness courses are the domain of the 
humanitarians who have no particular expertise in technotogy, nor (heaven forbid) any desire to 
acquire it. Such courses are for the thinkers and the poltey makers who doni need to get their 
fingernails dirty. 

By contrast, the competence course lies at the interface of the physical sciences with the 
wori^hop environment, and engineering Is the dominant manifestation. Engineering courses are 
generally very content laden and specifte (lighting engineer, heating , sound, mechanical, nuclear, 
aeronautical etc etc engineer). Whilst the traditional UK universities (for scholastic snobbery 
reasons) dW their best to cleanse such courses of their practical woricshop raison d'etre, the best 
courses are built around a tight integration of practice and theory. 

But now we have a new beast - the capability course - that is designed not to replicate either of the 
former approaches, but rather to appeal to a quite new constituency. So where dkl it come from, 
what does it involve, and what qualities does it require and engender ? Whilst this new school of 
thought in technotogy in the UK has evolved from the former schools of thought largely through 
the innovatton of teachers concerned with the ecA/caf/ona/ significance of what they were doing, 
nevertheless - as we shall see - their efforts have subsequently been endorsed and supported by 
irxiustriaBsts concerned about the kinds of new recruits they will need to sun^ive in the 
mari^etplace. 



Technology as Thinking 

There is an astonishing ctoseness between descriptions of the process ot design & technotogy 
and the process of thought. This is so marked that there are areas where the two merge quite 
naturally. At the end of a very tong treatise on Thinking", Humphreys defines thinking as .. 

%vhat happens in experience when an organism, human or animal, meets, recognises, and solves a 
problem" (Humphreys 1951) 

•^Problem soMng** gets the full treatment from psychok>gists seeking to describe and explain the 
processes of thought. Thomson (1959) outlines the characleristtos of problem solving behavtour; 
Kuble (1962) relates it to the 'cybernetics' theory of teaming; Vygotsky (1962) links It to the 
devetopment of language and parttoulariy to symbolto representatton and Dewey (1910) relates it 
to s'^hools and educatfon. Normally - the argument runs • we ctont think at all so tong as things run 
smoothly for us. Habit, impulse and well practfced routine help us to drift through much vaork and 
play. It is unly when the routine is disrupted by the intruston of a diff icufty that we are forced to stop 
drifting and think about what we are going to do. 
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The process is seen (broadly) as one involving problem clarification, investigation and exploration, 
analysis, creative attack, and subsequent re~evaluation. In fact it is - in generic form - the design 
process we examined in part one of this report. "Design methods** are operational models of 
thinking and if one takes away the specifics of materials and tools, then the intellectual process 
described on page 3 is an exact replica of the process of thought as described by Thomson et al. 
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The process of designing is a concrete 
manifestation of the process of thinking. 



Designing is - in a sense * concrete thinking and it is no coincidence that in practice designers 
frequently talk of themselves as Ihinking with a pencil" , a quality that we expfcitly encourage in 
young people in technology programmes. 

This realisation has provided the central pedagogic underpinning that has carried forward the 
development of Technology in schools in the UK. 

From the simplest problem to the most complex, the design process is concerned with the 
educational problem of clarifying the thought process or 'reasoning' of the chiid, indeed it is an 
attempt to lay bare before the child his (sic) own thinking. (Kimbell 1975) 

The principal aim of Handicraft was the physical arid emotional development of boys, mainly through 
the gradual acquisition of skills. Craft Design & Technology extends this to provide a fuller 
experience in which cognitive development features more strongly. Its central aim is to give girls 
and boys confidence in identifying, examining, and f inalfy solving problems with the use of 
materials. (Department of Education and Science 1977) 

Whereas the practical use of materials and the consequent development of nrtotor skills had once 
provided the whole raison d'etre of wortcshop courses, in this new interpretatk>n of Technology it 
became evident that a different kind of rationale was emerging; a rattonale that saw materials and 
tools as the vehicle of learning rather than the purpose and point of learning. Whereas handterafts 
had supported the enx)tional and physical development of young people. Technology was 
additionally demanding and encouraging intellectual growth. 

The special feature of this encouragement is that - unlike so much of the currkxjium - the 
processes of thought and decision making in Technotogy are exposed to the light of day. When 
you go through a design folder you can see the decision making unfolding before your eyes 
because the graphics, the nrK)dels and the prototypes are clear concrete expressions of that 
thinking. There are several major consequences of this; 

• you can go back over it with the pupil to examine where critical decistons were made 
you can look to see the basis of evidence for that decision 

• you can examine points at which alternatives woukJ have been possible 

• and you can use these as jumping off points into new lines of development 
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In short Technology not only enhances the thinking and decision making powers of young pMple. 
It also enhances their conscious awareness of those thought processes. ^ They not only leani 
strategies of thought, they also know (and can see) that that is what they are doing. 

And the final twist to this tale is that the pupil constituency to whfch this activity has tradittonally 
appealed Is not one that had held intellectual development at the top of Its agenda. Before the 
implementatton of the Nationai Curriculum (whfch made Technotogy a compulsory study for all 
pupils) there was more than a fair share of diffkxjit and disenchanted pupils in most Technotogy 
dasses. They tradittonally found refuge and strength In the practtoal orientatton of the teaming 
environment. For these pupi!s, technotogy has often been a transfonming experience, not just 
because it kept them busy and out of trouble (whtoh was often the rattonate in craft courses) - but 
because it provkJes a concrete tever that can expose and get a purchase on their thought 
processes. 

However this opening up of the thinking and deciston-making processes that pupils engage in in 
technotogy is cleariy dependent upon a further factor. Thought (of any kind) is dependent upon 
language. As the phitosopher Langer points out.. 

Language oi cours© is our prime instrument of conceptual expression. The things we can say are in 
effect the things we can think. Words are the terms of our thinWng as well as the terms in which we 
present our thoughts, because they present the objects of thought to the thinker himself. Before 
language communicates kJeas ft gives them form, makes them dear and in fact makes them what 
they are. Whatever has a name is an object of thought. 
(UngerS 1962) 



The Centraltty of Communication 

This view of the interdependence of language and thought^ was seen by Langer to be about the 
use of words. Whilst I have no disagreement with the sense of what is proposed by Langer, 
Vygotslv et al , it is clear that the 'language' of technotogy Is not - or at teast not dominantly - 
words. It is images and models that are the central planks of thinking in technotogy. So Langers 
toea has to t>e transposed somewhat... 

...the things we can draw are the things we can think. Images are the terms of our thinking as well as 

the means by which we present our thoughts before a model communicates an Mea it gives it 

form and makes it clear . Whatever can be drawn and modelled can be an object of thought 

(with apologies to Langer) 

When trying to describe a complex three dimenstonal form, words are quite inadequate and images 
need to take over. Symbols (eg road signs) convey certain kinds of informatton far more qu;r?4dy 
and eff toiently than words can. If the reader needs any persuaston of this fact, try to rt^scribe in 
words how a door handle works - and then compan^ it to the ease with whtoh onb can describe the 
same thing diagrammatically. 

This cmclal relattonship between a chiWs thinking and their ability to Image & model lay at the heart 

of the APU project in Design & Technotogy. 

..the act of expression pushes kieas forward. By the same token, the additional danty 
that this throws on the idea enables the originator to think more deeply about it. which 
further extends the possibilities of the idea. Concrete expression (b^ whatever means) is 
therefore not merely something that allows us to see the designer's Weas. it is something 
without which the designer in unable to bn clear what the kieas are.. 



^ The term *nr)eta-cognition* has been applied to this phenomenon. 
2 Vygotsky 's woric here has been also highly influential 
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Cognitive modelling by itself - manipulating ideas purely in the mind's eye • has severe 
limitations when it comes to complex ideas and patterns. It is through externalised 
modelling techniques that such complex ideas can be expressed and clarified, thus 
supporting the next stage of cognitive modelling. 

tt is our contentiori that this inter-relationship between modelling ideas in the mind and 
modelling ideas in reality is th^ cornerstone of capability in design & technology. It is best 
described as Ihought in action". 
(Kimbell1991 and 1991(b)) 

Nigel Cross, in his work at the Open University has similarly been drawn to the distinct language of 
technology. Having identified the mode of thinking in technology as 'constructive*, he goes on to 
consider the 'codes' that translate abstract requirements into concrete objects, and the fact that 
we both 'read* and V/rite' in these codes. He goes on to make a powerful case for technok>gk)al 
activity in the cumculum largely on these grounds - that it enhances pupils ability to operate in the 
•iconic modes of cognition". 

And these modes of thought are essential for all, not just for designers, as we all operate in a world 
in which object language is as vital as any other language. When we interact with objects (as 
opposed to abstract ideas) we need appropriate modes of communication. Imagine for example 
the difficulty of playing chess without a chess board. I know one or two people who claim to be 
able to do it - but most of us get along rather better (and are able to devetop and think through 
more sophisticated strategies) when supported by the use of a concrete model - a chess board. 

Thought and expression exists in a tight iterative relationship and this iteration was central to the 
APU tests that we developed. As i pointed out in part 2, the vast majority of tests and 
examinations in schools ignore this iteration where it brkjges between the conceptual and the 
practk^al. Written tests allow pupils to grapple with kieas that are best expressed in words, whilst 
practical tests (in music, craft, and even science) typically confine themselves to the demonstration 
of skills that have already been mastered. 



Internal images in the 
mind's eye 




Concrete expressions that 
allow us to examine the 
reality of an idea 



TMnkIng tieto iteepefv 
clearer and inoni 
^eUHett 



as 



Ihe clftttty ^M^^retelon 
. 4iticnm lip wiiat^^ 
what It not possible. 



The iterative relationship between thought and expresston 



Neither of these forms of testing is suited to technotogy. where kJeas conceived in the mind need 
to be expressed in concrete form in order for them to be taken further. The test forms that we 
eventually resolved for APU were in effect a manifestation of the iteratton of thought and actton 
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described in the above graphic. 



Knowledge and Technology 

Whilst the teaching of craft skills has been a pervasive influence in the emergence of technology, 
the position and role of knowledge has only relatively recently come to be debated. And the 
uKimate question is what is it necessary to l<now before one can design and make things? 

The first two schools of technotogy (the 'humanitarians' and the 'engineers') have, quite naturally, 
. very different answers to this question. The engineers in particular will go on at length about all the 
branches of phystoal science that it is necessary to know. But we are interested here in the 
broader 'capability' school of thought - and the extent to which this capability necessarily entails 
knowledge about x,y, or z. 

There have been plenty of warnings sounded about the dangers of being too prescriptive and 
heavy handed in technology. 

When there is a body of received knowledge to be acquired l3efore speculation and imagination can 
be given free reign, then curiosity and enthusiasm will surely be quenched....lt is most important not 
to equate intellectual rigour with excessive reliance upon the committing to memory of large 
quantities of factual information. (Dainton 1968) 

More recently, and in the specify context of the devetopment of technotogy in schools in the UK, 
the former Senior Staff Inspector for technology gets to the heart of the matter; 

Teaching facts is one thing; teaching pupils in such a way that they can apply facts is another, but 
providing learning opportunities which encourage pupils to use information naturally when handling 
uncertainty, in a manner which results in capability, is a challenge of a different kind. (Hicks 1983) 

The diff kxjity in dealing with ^knowledge' in technotogy is to know what it is that you need to know. 
One task needs a quite different set of knowledge to another task. If I am to design a bivouac tent 
for mountaineering, I need to know about loads, stnjctures, and temperature induced fatigue (in 
materials as well as in humans); if I need to design a tigging system I may need to know about tow 
voltage electricity and switching systems. Moreover, it is not until I am half way into the tent task 
that i realise i need to know about the fixing conditions on rock faces, or the sheer load that can be 
borne by double stitching, or how the friction coefficient of the fabric changes with temperature. 
And if such infomiatton is not readily researchable, I need to devise a way of finding these things 
out. 

V^en embarking upon a new design, the package of knowledge and skills necessary for the 
success of the venture will emerge as the design progresses, and so the need to acquire 
knowledge and skills (and sometimes extend the boundary of knowledge and devise new skills) 
becomes a clear requirement for the designer ( CNAA/SCUE 1985) 

The designer does not need to know all about everything so much as to know what to find out, what 
fonri the knowledge should take, and what depth of knowedge is required for a particular purpose 
(DES19d1) 

For pupils to be effective in technok>gy they need a cavalier approach to knowledge boundaries. 
They must at times be scientists (setting up experiments to find things out) , at times they must be 
social scientists (devising opinion questionnaires) , at times they must be good researchers (able 
to hunt out knowledge from books/databasesAechnical spectficattons) and - pertiaps most crittoal 
of all • they must at all times be good at asking the right questions of the right people. 

It is for these reasons that technotogy courses have been very cauttous about trying to 
predetermine the body of knowledge that Is a necessary pre-requlsite of capability in technok)gy. 

Almost every syllabus statement produced In the last ten years will have bokl disclaimers " it is 

just not possibte to define exactly what one will be required to know about in advance of the activity.. ** (SEC 
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1985). And typically they then go on to outline the attitudes pupils need tc '^ands knowledge - and 
the strategies they need to learn to handle these "deslgnerly ways of knowing*. These strategies 
are always then presented in terms of liberal and flexible views of the nature and role of 
knowledge and emphasise the role of the teacher in supporting pupils in pursuing task-related 
knowledge for themselves. 

The recognision that new knowledge and skills are needed in order to continue is provoked by the 
questions that arise in their speculations, and the crucial role of the teacher at this point is in 
hewing pupils to recognise and address these questk}ns. The *need to know' is the bridge which 
gves pupils acx^ess into the universe of extemal knowledge and skill and motivates them to proceed 
beyond their existing capabilities and resources. (DES 1987(b)) 

With knowledge, the mark of capability in technok>gy is not established by measuring how much 
of it pupils hold, but by seeing how effective they are in seeking it out in response to their task. 
And whilst the reasoning behind this devetopment has been entirely driven by educaltonal 
concerns, this is an area in which empbyers have wholeheartedly endorsed the devek)pment. 
There are few emptoyment situattons in whbh young people can simply apply what they already 
know. Far more frequently they need to be imaginative and resourceful in adapting and extending 
their knowledge to the immediate circumstances in which they find themseh^es. 



Co«operatlve Learning 

As 1 have outlined in sectton 2 of this report, the issue of collaborative working in technology is 
taking on ever increasing importance. We established, in the APU modelling tests that there is 
major benefit to be gained by pupils from sharing kleas at the development phase. The pupils' 
response to each others critk^ism was a ntajor force in shaping the success or failure of their wortc. 
This is also a factor that has been kJentifted in another technok)gy initiative - TVEI > the Techntoal & 
Vocattonal Educatton Initiative launched by the Department of Trade and industry in the eariy 
1980s. This programme in partk:ular recognised that it is only in schools where pupils are expected 
to spend all their time wortdng on their own. In industry, teaiiiworic is the norm. Whatever sector of 
business and industry you are in, tream work is typk:ally at the heart of the woridng environment - 
productton teams, sales/martceting teams, design teams, research teams, planning teams. Where 
are students to learn the skills of wortdng in teams ? 

The TVEI programme sought quite spocirically to transform this view of leaming as an indh^Mual 
activity and built its reoommendatbns for practbe around more collaborative approaches. The 
programme involved.. 

a more practical, assignment ted, group work pattern.... 

and one in whk:h... 

the more relaxed relationship between student and teacher provided greater responsibility for 
students to be responsible for their own learning (Pring 1986) 

Within the APU project we sought quite specif k:ally to gather data about the effectiveness of team 
activities in technology. We were convinced from out own experience that children find it easier to 
make progress when they have the opportunity to use other people as a resource - as a sounding 
board against which to test ideas. But more than this, groups offer the opportunity to pool 
expertise and experience, and to draw on the indivkiual strengths that indivkluals bring to the 
team. 

I have described in part 2 the placement of the group discusston session within the heart of the 
modelling tests and the perception by the administrators that this had been helpful to many pupils. 
The pupil data supports this impression, for when we asked pupils to comment (in a post-test 
questtonnaira) on the extent to whteh they found the discussions helpful in sorting out their ktoas, 
the foUowing responses emerged. 
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No help 


8.6% of pupils 


SofTiA hdlD 


34.32% of pupils 


Very helpful 


56^1% of pupils 


No response 


O.B5% of pupils 




total sample « 1288 pupils 


< 





Student responses with group discussion 



Again, one has to be clear that there is nothing especially technological about this situation. I am 
confident that if pupils were given the same collaborative opportunities in a history project and 
then asked the same question, the same data would emerge. But technology does provide 
wonderful opportunities for collaborative approaches - and the nrxKlels cunrently operating in 
industry provide concrete exemplification not only of the need for pupils to become familiar with 
this way of working but of the i)ene/?tethat can accrue from it. 



Values In Technology 

But the central question about technology is still to be answered. We know - as teachers - that 
the core of the activity lies in the iteration of thought and actton; that it has a particular language; 
and that it is parasitic on any body of knowledge that it might find useful. But we have yet to deal 
with the central questk>n. Why do societies develop technok)gy ? What is it all for ? 

It Is to do with the notion of improvement. The basic nx)tive that underlies any technotogfcal 
activity is that we can inten/ene to modify and improve our environment. 

Among the multitude of animals which scamper, fly, burrow, and swim around us, man is the only 
one who is not locked into his environment. His imagination, his reason, his emotional subtlety and 
toughness, make it possible for him not to accept the environment but to change it. And that series 
of inventtons, by which man from age to age has remade his environmerrt... I call ... ThoAscontof 
Man. (BronowskiJ 1973) 

Technotogy is by def initton task centred, and results in some manifest change to the made worid. 
The motive of "improvemenf however naturally implies more than simply change. It imples 
change for the better, and this inevitably makes the concept of improvement somewhat 
problematic. 

V\/hether you see something as being 'better* will depend entirely on your value position. Is it *l>etter' 
to burn cheap fuels (based on hydro-cartx>ns) or renewable fuels? Is it better to have motorways or 
the acres of open country that they use up? Inevitably design and technology impacts upon and is 
influenced by the political, economic, physical and social world in which we live and these 
influences create the climate in which some outcomes are seen as more desirable than others. 
(Kimb9lletal1991) 

To engage In technotogy is to engage in a value-laden activity and - in an educattonal context - this 
makes it ntassively rtoh. Because the technotogist is not merely a bystander in this value laden 
debate but has to find ways of resolving the conf Ikns that are an inevitable part of the technologtoal 
endeavour. Shall I make it cheap (so that everyone can but it) or shall I make it so it will last a tong 
lime (so its good value for money) or shall I make it out of recyclable materials etc etc etc. The 
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technologist has to optimise a solution to these dilemmas. 

This balancing of value judgements defines the purpose of the task - conditions the way we 
resolve it - and ultimately decides whether or not others regard it as successful. In short values 
pervade technology. 

For pupils in school, this is a seriously challenging position to be in. tt requires them first of all to 
identify the value positions of those involved in the exercise - what would they see as a 'good* 
solution to this problem ? And l<nowing these positions allows one to sift the evidence in particular 
ways and develop a specification for a solution that is (as far as possble) agreeable to all parties. 
Once again, as in the question of language discussed above, technology provides concrete 
examples of social dispute. Ke wants it nice this - but she wants it like that; this group's priority is to 
liave it by next week - but if I do that I woni be able to .... This exercise is made even more drfftoult 
by the fact that we typtoalty disguise our values and present them as facts. We commonly say you 
cam have it like thar - when it woukJ be more acurate to say "I woukJ prefer you not to have it like 
thar. Identifying values * and distinguishing them from facts is a key element in the devetopment 
of capability in young people. 

in the UK Nattonal Curriculum, these concems are reflected in attainment statenDents described in 
the following temns. Can the pupil... 

• recognise the points of view of others and conskier what it is like to be in another 
person's situatton. 

•explain that a range of criteria whk:h are sometimes confltoling must be used to make 
judgements 

•understand that artefacts, systems or environments reflect the circumstances and values 
of partk:ular cultures and communities. 

(DES 1989) NB. these assessment statements apply to 1 2 yr olds. 

Yet again one might argue that there is nothing especially technok)gtoal about these qualities - and 
of course this woukJ be true. But once again, whilst these issues might be shared by any activity in 
the cunicukim, in technotogy they cannot be hidden in abstract debate - they are made manifest in 
real products that you can see, use, argue about, and seek to Improve". This concreteness is 
enomnously valuable in giving young people access to issues that might Oihenvise pass them by. 



Technology and Employment 

It is a fact of life that there i^ perceived to be a direct link between technotogy in schools and 
subsequent industrial emptoyment. Whilst it is acceptable that the school study of history should 
not be conditioned by the needs of that proportion of pupils who will become historians, in 
technology it is different. Even when (as in the UK currently) industrial manufacturing emptoyment 
is small in comparison to other emptoyment, the influence remains. And interestingly, over the last 
twenty years, there has been a sea change in the percepttons by industry of what it needs from its 
new recruits. 

Reports addressing technotogy have focused on engineering priorities, and in a series of offk:ial 
Govemment papers. Swan (1968) CoriiekJ (1976) Finniston (1980) and the National Economk: 
Development Offk:e/MSC (1984) castigated the constrained and knowledge focused nature of so 
much of the educatton of students for engineering. 

•*Rrst degree courses in technology are not sufficiently wkiely based to meet the needs of the 
individual and his (sic) empk>yer* 

• *The whole burden of developing competent engineers at present falls upon industry itself* 
•'Complaints commonly voiced by employers are that the education of engineers is unduly scientific 
and theoreticar 

•'Iruiustry and Government need to insist on a more broadiy based syllabus for engineering 
students*. 
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It was against this l)ackground that technology courses in schools • of the kind outlined above - 
have developed, and increasingly they have been widely welcomed by industry. This welcome 
has been evident not just in their words of support, but more tangibly in their sponsorship of 
technology projects. BP for example are cunrently funding a major Technology in Context* 
programme of teacher support specifically related to National Curriculum technology and a series 
of sponsors over a number of years (including Rolls Royce and GEC) has supported the Schools 
Design Prize (organised through the Design Council) and the Young Engineer for Britain 
competition (organised by the Engineering Council). 

Many national figures - not least Margaret Thatcher - became great advocates for technology, one 
notable industrial leader. Sir Alex Smith, adding (in 1980) to the claims for technology to be a part 
of e^rery child's currioilum. 

Every child in every school, every year, should be required to design something and make 
it...Education through designing and making is a basic need, even if our industries were blazingly 
successful, whk:h they are manife&ily not (Smith A 1980) 

This trend is one that echoes very ctosely the SCANS report for America 2000 "What Work 
Requires of Schools". 

• good jobs will increasingly depend upon people who can put knowledge to wort<. 

• the most effecth^e way of learning skills is in context" , placing learning objectives within 
a real environment rather than insisting that students leam in the abstract what they will be 
expected to apply. 

(SCANS Seaetary's Commisston on Achieving Necessaiy Skills 1991) 

The report then goes on the outline the constituent parts of a foundatton, nfx>re than half of which 
is made up of the folk>wing list: 

• Creative thinking 

• Deciston making 

• Problem solvirig 

• Seeing things in the mind's eye 

• Knowing how to leam 

• Reasoning 

• Responsibility and Self management 

Given the lit' between this list and the qualities demanded and devetoped through a technok)gical 
capability programme of the kind outlined above, it is not surprising that emptoyers are warm to the 
products of these courses. 

The days of industiy requiring specifk: skill4rained emptoyees are gone. And so too are the 
schoohbased craft programmes that once fed this empk>yment. Technology as outlined here is 
not only seen by teachers as an educattonally enriching experience for all pupils * and a necessary 
pari of the compulsory curriculum it is also sought out by emptoyers as providing the levels of 
employee excellence that they need. 
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Conclusion 



Technology in the school curriculum has grown from practice rather than from theory; from 
teachers In the classroom trying out Innovative and often idiosyncratic activities and programmes - 
rather than from an intellectual analysis of a field of knowledge. And it has been hugely successful. 
Pupils voted with their feet; courses expanded and proliferated; competitions and prizes led to 
high profile public exposure where politicians and others were delighted to shake a few hands for 
the camera. Eventually, with the growth of Advanced level work, even the universities caught up 
with the fact that there were some quite exceptional young talents coming through this route and 
increasingly sought then. out. As I hope I have shown, this growth has been steered by national 
projects, fostered by nattonal initiatives and gradually been disseminated to a wkle teaching force. 

But the roots of its success lie In individual classrooms, studios and workshops where imaginative 
teachers sought to aeate not just a new subject - but a new approach to learning. Technotogy is 
now coming of age and has been made a compulsory study for all pupils. This process has 
required that it be tamed and instituttonalised so that every teacher can cope with it and we shoukl 
not be surprised when this process proves difficult. 

It is difficult because ultimately technok>gy cannot be defined in a body of knowledge and skills. It 
is better described as a set of kJeals and processes Into which pupils need progressively to be 
drawn. Naturally this induction relies upon the pupil developing knowledge and skill, but 
ultimately, pupils are not to be judged by their mastery of these skills so much as by their ability to 
recognise and grasp opportunities to change and improve the workl through the exercise of their 
creative talents. 

This was the big kJea that Bronowski chronicled in The Ascent of Man and that lay at the heart of 
those ptoneering courses in the 1960'S and 70's. There is every reason to believe that it is an kJea 
whose time has come. 
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